00000001:02000400:2.0F:1789427617.194222:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789427636.054862:0:3175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789427638.194260:0:3236:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 955 MB/s 00000001:01000000:0.0F:1789427638.446274:0:3236:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 646 MB/s 00000001:01000000:2.0:1789427638.697129:0:3236:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4267 MB/s 00000020:02000000:2.0:1789427639.492898:0:3267:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_41_g9380d02 00000400:02000000:3.0F:1789427640.386203:0:3282:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.155@tcp [8/256/0/180] 00008000:02000000:3.0:1789427644.151815:0:3432:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789427692.918861:0:5237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789427701.883806:0:5816:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789427701.883812:0:5816:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789427701.884394:0:5816:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d28f91fc 00000080:02000400:3.0:1789427701.884411:0:5816:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789427701.898910:0:5816:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789427701.898929:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789427701.898974:0:5816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000acceb08) 00000020:00000080:3.0:1789427701.898998:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789427701.942009:0:5816:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789427701.942830:0:5816:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789427701.969746:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789427701.969788:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789427701.969810:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789427701.969859:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789427701.969884:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789427701.970457:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789427701.970465:0:5816:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789427701.970475:0:5816:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca342fe8 00000020:01000004:3.0:1789427701.970483:0:5816:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789427701.970488:0:5816:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789427701.970493:0:5816:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d28f91fc from MGS 00000020:01000004:3.0:1789427701.970497:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789427701.970507:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000056ed160d) 00000020:00000080:3.0:1789427701.970517:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789427701.970566:0:5816:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d28f91fc from MGS, refs=2 00080000:01000000:3.0:1789427701.970571:0:5816:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789427701.970576:0:5816:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca342ff6 00000100:00100000:3.0:1789427701.970972:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789427701.971423:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789427701.971430:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789427701.971981:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789427701.971989:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789427701.973002:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789427701.973357:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789427701.973363:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0F:1789427701.974141:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789427701.974156:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789427701.974680:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789427701.974687:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789427701.975560:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427701.975563:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427701.975565:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427701.975941:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427701.975944:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427701.975946:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427701.976795:0:5816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789427701.982453:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789427702.226306:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2907 MB/s 00000001:01000000:1.0:1789427702.476270:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3403 MB/s 00000001:01000000:2.0:1789427702.726632:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1067 MB/s 00000001:01000000:2.0:1789427702.976846:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1027 MB/s 00010000:00010000:3.0:1789427702.985497:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789427702.987130:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789427703.003556:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789427703.003574:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789427703.003577:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789427703.004834:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789427703.004901:0:5816:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789427703.004943:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789427703.005130:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789427703.006708:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789427703.007809:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427703.008004:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789427703.008010:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789427703.011911:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789427703.011924:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789427703.012418:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789427703.012425:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789427703.012966:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789427703.012989:0:5816:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.155@tcp' 00000020:01000004:2.0:1789427703.012991:0:5816:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789427703.013035:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.155@tcp (typ=mgc) 00000020:00000080:2.0:1789427703.013055:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.155@tcp (000000008884fad1) 00000020:00000080:2.0:1789427703.013072:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:0.0:1789427703.014771:0:5830:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1789427703.014935:0:5816:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c9f7dc83@MGC192.168.201.155@tcp: add connection 192.168.201.155@tcp at head 00010000:00010000:1.0:1789427703.015124:0:5816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.155@tcp-0 is initialized 00000040:01000000:1.0:1789427703.015131:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789427703.019291:0:5831:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789427703.019437:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.155@tcp (uuid cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca) 00000020:00000080:1.0:1789427703.019463:0:5816:0:(genops.c:1384:class_connect()) connect: client cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca, cookie 0x2bea1a57ca343004 00000100:00080000:1.0:1789427703.019475:0:5816:0:(import.c:545:import_select_connection()) MGC192.168.201.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789427703.019487:0:5816:0:(import.c:666:import_select_connection()) MGC192.168.201.155@tcp: import 00000000c9f7dc83 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:1.0:1789427703.019539:0:5816:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c1ed8079 x1876350877040768/t0(0) o250->MGC192.168.201.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789427703.019571:0:5816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca->MGS 00000020:01000004:1.0:1789427703.019597:0:5816:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789427703.019602:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789427703.019621:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006c3dcdb7) 00000020:00000080:1.0:1789427703.019634:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789427703.022599:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1ed8079 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3297:1876350877040768:0@lo:250: 00000100:00100000:0.0:1789427703.025669:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427703.025824:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877040768 00000100:00100000:2.0:1789427703.025836:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877040768 00000100:00100000:2.0:1789427703.025879:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427703.025896:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000161ec85c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1876350877040768:12345-0@lo:250: 00010000:00080000:2.0:1789427703.025926:0:5827:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:2.0:1789427703.025957:0:5827:0:(genops.c:1384:class_connect()) connect: client cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca, cookie 0x2bea1a57ca343012 00000100:00080000:2.0:1789427703.028573:0:5827:0:(import.c:65:import_set_state_nolock()) 00000000445ef5f1 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427703.028694:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000161ec85c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+5:3297:x1876350877040768:12345-0@lo:250: Request processed in 2796us (3030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427703.028706:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427703.028752:0:3297:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789427703.028760:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.155@tcp: connect to target with instance 0 00000100:00080000:2.0:1789427703.028767:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789427703.028772:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789427703.028775:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000c9f7dc83 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789427703.028777:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789427703.028793:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789427703.028799:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1ed8079 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3297:1876350877040768:0@lo:250: 00000100:00100000:1.0:1789427703.040145:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427703.040493:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789427703.040501:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789427703.043607:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789427703.043627:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789427703.048120:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789427703.048148:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789427703.049382:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427703.049573:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789427703.049579:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789427703.051688:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789427703.051701:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789427703.117860:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427703.118138:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789427703.118150:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789427703.123875:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789427703.123893:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789427703.124890:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427703.125382:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789427703.125389:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789427703.125834:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789427703.125840:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789427703.139954:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427703.140221:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789427703.140228:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789427703.140855:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789427703.140862:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789427703.141657:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427703.141835:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789427703.141841:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789427703.142504:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789427703.142511:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789427703.190663:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789427703.190857:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789427703.190864:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789427703.200917:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789427703.200934:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789427703.201545:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789427703.201553:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789427703.212779:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789427703.212814:0:5816:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789427703.212821:0:5816:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789427703.212992:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789427703.213026:0:5816:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.155@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789427703.213030:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789427703.213032:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789427703.213033:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427703.213035:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427703.213036:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427703.213037:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427703.213038:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427703.213040:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789427703.213044:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427703.213045:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427703.213047:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427703.213048:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789427703.213050:0:5816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789427703.213052:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789427703.213053:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789427703.213054:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427703.213055:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427703.213056:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427703.213057:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427703.213057:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427703.213058:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789427703.213059:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427703.213060:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427703.213061:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427703.213061:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789427703.213108:0:5816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789427703.213128:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009df5a3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877040896:0@lo:253: 00000100:00100000:1.0:1789427703.213236:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427703.213299:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000301a0360 going to sleep for 11 seconds 00000100:00100000:0.0:1789427703.213380:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877040896 00000100:00100000:0.0:1789427703.213389:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877040896 00000100:00100000:0.0:1789427703.213451:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427703.213460:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001782a990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+5:5816:x1876350877040896:12345-0@lo:253: 20000000:01000000:0.0:1789427703.213504:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789427703.213507:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789427703.214055:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789427703.214125:0:5829:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789427703.214491:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789427703.215504:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789427703.215695:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789427703.215699:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789427703.215704:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789427703.215708:0:5829:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789427703.215723:0:5829:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789427703.215925:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427703.216139:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789427703.216153:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789427703.216242:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789427703.216296:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789427703.216349:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789427703.216440:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789427703.216450:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789427703.216498:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789427703.216512:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789427703.216548:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789427703.216556:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789427703.216603:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789427703.216658:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789427703.216693:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789427703.216698:0:5829:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789427703.216712:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427703.216905:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789427703.216915:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789427703.216949:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789427703.216983:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789427703.217030:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789427703.217042:0:5829:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789427703.217113:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789427703.217122:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789427703.217167:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789427703.217231:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789427703.217265:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789427703.217276:0:5829:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789427703.217376:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789427703.217385:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789427703.217416:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789427703.217445:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789427703.217601:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789427703.217643:0:5829:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789427703.217650:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789427703.222799:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789427703.223220:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789427703.223247:0:5829:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.155@tcp for mdt 20000000:01000000:2.0:1789427703.223250:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.155@tcp (null) (null) (null) 00000040:00080000:2.0:1789427703.223285:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789427703.223292:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789427703.223335:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789427703.223342:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.155@tcp (null) (null) 00000040:00080000:2.0:1789427703.223388:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789427703.223401:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789427703.223434:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789427703.223469:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789427703.223536:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789427703.223545:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789427703.223551:0:5829:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789427703.223557:0:5829:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789427703.224684:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789427703.224812:0:5829:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789427703.241713:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789427703.241758:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1789427703.241906:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1789427703.241926:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789427703.241929:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789427703.241933:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789427703.241945:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789427703.241947:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789427703.241976:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789427703.241979:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789427703.242918:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789427703.243391:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789427703.243431:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789427703.243491:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1789427703.243502:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789427703.243505:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789427703.243922:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789427703.244701:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789427703.244743:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789427703.244777:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1789427703.244791:0:5829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789427703.244793:0:5829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1789427703.244800:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789427703.244905:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244922:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244933:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244939:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244945:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244952:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244958:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005812ca4a already unused, calling callback (0000000072ecadce) 00010000:00010000:3.0:1789427703.244961:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244968:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244980:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244987:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.244993:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005812ca4a/0x2bea1a57ca343019 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789427703.245020:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789427703.568929:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001782a990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+5:5816:x1876350877040896:12345-0@lo:253: Request processed in 355458us (355681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427703.568978:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427703.569135:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009df5a3a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877040896:0@lo:253: 10000000:01000000:3.0:1789427703.569156:0:5816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789427703.569160:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789427703.569162:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789427703.569164:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789427703.569165:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789427703.569167:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789427703.569168:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789427703.569170:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789427703.569171:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789427703.569266:0:5816:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789427703.569268:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789427703.569270:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789427703.569295:0:5816:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d28f91fc from lustre-MDT0000 10000000:01000000:3.0:1789427703.569339:0:5816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789427703.569342:0:5816:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789427703.569347:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9334101b3380 10000000:01000000:3.0:1789427703.569352:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789427703.569362:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9334101b3380 from 1 10000000:01000000:3.0:1789427703.569366:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789427703.569432:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 000000005812ca4a/0x2bea1a57ca343020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.569445:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 000000005812ca4a/0x2bea1a57ca343020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.569455:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 000000005812ca4a/0x2bea1a57ca343020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427703.569476:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000058b821b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041024:0@lo:101: 00000100:00100000:3.0:1789427703.569545:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427703.569709:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000934d1da9 going to sleep for 11 seconds 00000100:00100000:1.0:1789427703.569755:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877041024 00000100:00100000:1.0:1789427703.569764:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877041024 00000100:00100000:1.0:1789427703.569875:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427703.569885:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e39ba2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+5:5816:x1876350877041024:12345-0@lo:101: 00010000:00010000:1.0:1789427703.569900:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427703.569916:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b268ccb7/0x2bea1a57ca343027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343020 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427703.569942:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b268ccb7/0x2bea1a57ca343027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343020 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427703.569954:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b268ccb7/0x2bea1a57ca343027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343020 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427703.569963:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b268ccb7, rc 0) 00000100:00100000:1.0:1789427703.570050:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e39ba2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+6:5816:x1876350877041024:12345-0@lo:101: Request processed in 167us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427703.570057:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789427703.570120:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000058b821b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041024:0@lo:101: 00010000:00010000:3.0:1789427703.570136:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 000000005812ca4a/0x2bea1a57ca343020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427703.570145:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 000000005812ca4a/0x2bea1a57ca343020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427703.572930:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000058b821b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041152:0@lo:501: 00000100:00100000:3.0:1789427703.573029:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427703.573531:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000934d1da9 going to sleep for 11 seconds 00000100:00100000:1.0:1789427703.573943:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877041152 00000100:00100000:1.0:1789427703.573955:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877041152 00000100:00100000:1.0:1789427703.574021:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427703.574030:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e65b4a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+6:5816:x1876350877041152:12345-0@lo:501: 00000100:00100000:1.0:1789427703.574421:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e65b4a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+6:5816:x1876350877041152:12345-0@lo:501: Request processed in 392us (1391us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427703.574431:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789427703.574492:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000058b821b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041152:0@lo:501: 10000000:01000000:2.0:1789427703.575003:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789427703.575026:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 000000005812ca4a/0x2bea1a57ca343020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427703.575035:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 000000005812ca4a/0x2bea1a57ca343020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427703.575043:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933433d9c800 10000000:01000000:2.0:1789427703.575050:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789427703.575055:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff933433d9c800 10000000:01000000:2.0:1789427703.575057:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789427703.575060:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff933433d9c800 from 1 10000000:01000000:2.0:1789427703.575064:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789427703.575210:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 0000000053f557d0/0x2bea1a57ca34302e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427703.575217:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 0000000053f557d0/0x2bea1a57ca34302e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427703.575225:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 0000000053f557d0/0x2bea1a57ca34302e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427703.575248:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb641ec1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041280:0@lo:101: 00000100:00100000:2.0:1789427703.575314:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427703.575346:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a25e08f going to sleep for 11 seconds 00000100:00100000:0.0:1789427703.575383:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877041280 00000100:00100000:0.0:1789427703.575393:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877041280 00000100:00100000:0.0:1789427703.575435:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789427703.575442:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004acfdbd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+6:5816:x1876350877041280:12345-0@lo:101: 00010000:00010000:0.0:1789427703.575454:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427703.575471:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000026bb7904/0x2bea1a57ca343035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34302e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427703.575493:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026bb7904/0x2bea1a57ca343035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34302e expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427703.575501:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000026bb7904/0x2bea1a57ca343035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34302e expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427703.575521:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000026bb7904, rc 0) 00000100:00100000:0.0:1789427703.575566:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004acfdbd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+7:5816:x1876350877041280:12345-0@lo:101: Request processed in 125us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427703.575570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789427703.575673:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb641ec1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041280:0@lo:101: 00010000:00010000:1.0:1789427703.575700:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 0000000053f557d0/0x2bea1a57ca34302e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427703.575711:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 0000000053f557d0/0x2bea1a57ca34302e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427703.575729:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789427703.575750:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 0000000053f557d0/0x2bea1a57ca34302e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427703.575759:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 0000000053f557d0/0x2bea1a57ca34302e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427703.575766:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789427703.575771:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789427703.575777:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff933433d9c800 10000000:01000000:1.0:1789427703.575780:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789427703.575783:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789427703.575786:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789427703.575818:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 00000000e8441095/0x2bea1a57ca34303c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427703.575826:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 00000000e8441095/0x2bea1a57ca34303c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427703.575834:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 00000000e8441095/0x2bea1a57ca34303c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427703.575851:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041408:0@lo:101: 00000100:00100000:1.0:1789427703.575877:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427703.575911:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000015850ce going to sleep for 11 seconds 00000100:00100000:2.0:1789427703.575988:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877041408 00000100:00100000:2.0:1789427703.575999:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877041408 00000100:00100000:2.0:1789427703.576110:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789427703.576121:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000001546ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+7:5816:x1876350877041408:12345-0@lo:101: 00010000:00010000:2.0:1789427703.576134:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427703.576146:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbcb09d5/0x2bea1a57ca343043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34303c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427703.576164:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbcb09d5/0x2bea1a57ca343043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34303c expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427703.576171:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbcb09d5/0x2bea1a57ca343043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34303c expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427703.576202:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbcb09d5, rc 0) 00000100:00100000:2.0:1789427703.576239:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000001546ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+8:5816:x1876350877041408:12345-0@lo:101: Request processed in 123us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427703.576243:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789427703.576287:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041408:0@lo:101: 00010000:00010000:1.0:1789427703.576298:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 00000000e8441095/0x2bea1a57ca34303c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427703.576315:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 00000000e8441095/0x2bea1a57ca34303c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427703.576371:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041536:0@lo:501: 00000100:00100000:1.0:1789427703.576400:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427703.579105:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877041536 00000100:00100000:0.0:1789427703.579123:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877041536 00000100:00100000:1.0:1789427703.579189:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000015850ce going to sleep for 11 seconds 00000100:00100000:0.0:1789427703.579214:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427703.579225:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000013f2429a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+8:5816:x1876350877041536:12345-0@lo:501: 00000100:00100000:0.0:1789427703.579631:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000013f2429a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:5816:x1876350877041536:12345-0@lo:501: Request processed in 407us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427703.579640:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789427703.579708:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041536:0@lo:501: 00000100:00100000:1.0:1789427703.579776:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041664:0@lo:503: 00000100:00100000:1.0:1789427703.579864:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427703.579893:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000015850ce going to sleep for 11 seconds 00000100:00100000:3.0:1789427703.580009:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877041664 00000100:00100000:3.0:1789427703.580016:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877041664 00000100:00100000:3.0:1789427703.580065:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789427703.580074:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005fa7464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:5816:x1876350877041664:12345-0@lo:503: 00000100:00100000:3.0:1789427703.580462:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005fa7464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:5816:x1876350877041664:12345-0@lo:503: Request processed in 390us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427703.580470:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789427703.581402:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877041664:0@lo:503: 00000100:00100000:1.0:1789427703.582012:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5857:1876350877041792:0@lo:502: 00000100:00100000:1.0:1789427703.582404:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427703.582497:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3fa837a going to sleep for 11 seconds 00000100:00100000:2.0:1789427703.582545:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877041792 00000100:00100000:2.0:1789427703.582553:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877041792 00000100:00100000:0.0:1789427703.582900:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789427703.582929:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000086258a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:5857:x1876350877041792:12345-0@lo:502: 00000100:00100000:0.0:1789427703.583265:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000086258a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:5857:x1876350877041792:12345-0@lo:502: Request processed in 351us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427703.583274:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789427703.584347:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5857:1876350877041792:0@lo:502: 00000020:01000000:1.0:1789427703.584404:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427703.584427:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427703.584430:0:5857:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789427703.584436:0:5857:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789427703.584439:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789427703.584458:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b4747841) 00000020:00000080:1.0:1789427703.584481:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789427703.584499:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789427703.585257:0:5857:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789427703.585267:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca343051 00000020:00000080:1.0:1789427703.585555:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789427703.585560:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427703.585565:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427703.585566:0:5857:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789427703.585569:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427703.585573:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427703.585575:0:5857:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789427703.585578:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789427703.585590:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000033021d96) 00000020:00000080:1.0:1789427703.585603:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789427703.585607:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789427703.585609:0:5857:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789427703.585612:0:5857:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789427703.585620:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789427703.586141:0:5857:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d28f91fc from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789427703.586158:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a7b22889) 00000020:00000080:1.0:1789427703.586168:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789427703.586508:0:5857:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789427703.586517:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca343066 00000020:00000080:1.0:1789427703.587452:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789427703.587462:0:5857:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789427703.587470:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2bea1a57ca34306d 00080000:01000000:1.0:1789427703.587477:0:5857:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789427703.587481:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca343074 00080000:10000000:1.0:1789427703.588534:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789427703.589079:0:5857:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789427703.599486:0:5857:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789427703.762888:0:5857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789427703.764019:0:5857:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789427703.770991:0:5857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789427703.772272:0:5857:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789427703.825986:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c56d6630) 00000020:00000080:2.0:1789427703.826020:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789427703.826090:0:5857:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789427703.826098:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca343082 00000020:00000080:2.0:1789427703.833157:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789427703.837199:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789427703.895248:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789427703.925973:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427703.974611:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:3.0:1789427704.010868:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789427704.021735:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789427704.087548:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789427704.128281:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2bea1a57ca343089 00000020:00000080:0.0:1789427704.128658:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789427704.128670:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427704.128677:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427704.128679:0:5857:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789427704.128682:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427704.128688:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427704.128690:0:5857:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789427704.128701:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789427704.128752:0:5857:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789427704.128767:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427704.128771:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427704.128772:0:5857:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789427704.128774:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427704.128777:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427704.128778:0:5857:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789427704.128781:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789427704.128782:0:5857:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789427704.129061:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6d5570c pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5857:1876350877041920:0@lo:502: 00000100:00100000:0.0:1789427704.129140:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427704.129231:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fb9ca71e going to sleep for 11 seconds 00000100:00100000:1.0:1789427704.129394:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877041920 00000100:00100000:1.0:1789427704.129410:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877041920 00000100:00100000:1.0:1789427704.129454:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789427704.129463:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b4b1e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:5857:x1876350877041920:12345-0@lo:502: 00000100:00100000:1.0:1789427704.129880:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b4b1e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:5857:x1876350877041920:12345-0@lo:502: Request processed in 417us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427704.129888:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789427704.130130:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6d5570c pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5857:1876350877041920:0@lo:502: 00000020:01000000:0.0:1789427704.130162:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427704.130167:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427704.130169:0:5857:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789427704.130206:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789427704.130426:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789427704.130444:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789427704.130466:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 00000000e8441095/0x2bea1a57ca34303c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.130478:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 00000000e8441095/0x2bea1a57ca34303c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427704.130486:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933433d9c800 from 1 10000000:01000000:1.0:1789427704.130489:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789427704.130518:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.130526:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.130536:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427704.130551:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042048:0@lo:101: 00000100:00100000:1.0:1789427704.130585:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427704.130615:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 0000000030a399cd going to sleep for 11 seconds 00000100:00100000:0.0:1789427704.130706:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877042048 00000100:00100000:0.0:1789427704.130712:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877042048 00000100:00100000:0.0:1789427704.130744:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789427704.130751:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ade653aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:5816:x1876350877042048:12345-0@lo:101: 00010000:00010000:0.0:1789427704.130761:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427704.130772:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343090 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427704.130863:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343090 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427704.130875:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343090 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427704.130892:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4158e3f, rc 0) 00000100:00100000:0.0:1789427704.130935:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ade653aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:5816:x1876350877042048:12345-0@lo:101: Request processed in 184us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427704.130941:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789427704.131501:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074da81c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042048:0@lo:101: 00010000:00010000:2.0:1789427704.131517:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427704.131525:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427704.132119:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f8338e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042176:0@lo:256: 00000100:00100000:2.0:1789427704.132164:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427704.132227:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000095e9c23 going to sleep for 11 seconds 00000100:00100000:0.0:1789427704.132489:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877042176 00000100:00100000:0.0:1789427704.132496:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877042176 00000100:00100000:0.0:1789427704.132532:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427704.132539:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000148f231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:5816:x1876350877042176:12345-0@lo:256: 20000000:01000000:0.0:1789427704.132557:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789427704.132563:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789427704.132636:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000148f231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:5816:x1876350877042176:12345-0@lo:256: Request processed in 97us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427704.132644:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789427704.132879:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f8338e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042176:0@lo:256: 10000000:01000000:2.0:1789427704.133675:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789427704.134385:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427704.134400:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427704.134409:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933433d9c800 from 1 10000000:01000000:2.0:1789427704.134412:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789427704.134452:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427704.134461:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427704.134482:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427704.134502:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f8338e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042304:0@lo:101: 00000100:00100000:2.0:1789427704.134557:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427704.134604:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000095e9c23 going to sleep for 11 seconds 00000100:00100000:1.0:1789427704.134738:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877042304 00000100:00100000:1.0:1789427704.134753:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877042304 00000100:00100000:1.0:1789427704.134813:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789427704.134821:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022ae423f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:5816:x1876350877042304:12345-0@lo:101: 00010000:00010000:1.0:1789427704.134833:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427704.134845:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34309e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.134867:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34309e expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.134877:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34309e expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.134885:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089c19055, rc 0) 00000100:00100000:1.0:1789427704.134932:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022ae423f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:5816:x1876350877042304:12345-0@lo:101: Request processed in 112us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427704.134939:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789427704.135149:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f8338e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042304:0@lo:101: 00010000:00010000:3.0:1789427704.135163:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.135171:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427704.135243:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007784e41a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042432:0@lo:501: 00000100:00100000:3.0:1789427704.135279:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427704.135308:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad488a79 going to sleep for 11 seconds 00000100:00100000:2.0:1789427704.135371:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877042432 00000100:00100000:2.0:1789427704.135376:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877042432 00000100:00100000:2.0:1789427704.135410:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789427704.135417:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056453a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:5816:x1876350877042432:12345-0@lo:501: 00000100:00100000:2.0:1789427704.136144:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056453a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:5816:x1876350877042432:12345-0@lo:501: Request processed in 727us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427704.136152:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789427704.136284:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007784e41a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042432:0@lo:501: 00000100:00100000:3.0:1789427704.136335:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007784e41a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042560:0@lo:503: 00000100:00100000:3.0:1789427704.136378:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427704.136410:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad488a79 going to sleep for 11 seconds 00000100:00100000:1.0:1789427704.136476:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877042560 00000100:00100000:1.0:1789427704.136481:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877042560 00000100:00100000:1.0:1789427704.136518:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789427704.136524:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1570b90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:5816:x1876350877042560:12345-0@lo:503: 00000040:00080000:1.0:1789427704.136561:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789427704.136601:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1570b90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:5816:x1876350877042560:12345-0@lo:503: Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427704.136607:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789427704.136644:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007784e41a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042560:0@lo:503: 00000040:00080000:1.0:1789427704.137554:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789427704.138092:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789427704.138115:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789427704.138165:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.138203:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427704.138255:0:5816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789427704.138259:0:5816:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933433d9c800 10000000:01000000:3.0:1789427704.138261:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933433d9c800 10000000:01000000:3.0:1789427704.138265:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789427704.138270:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933433d9c800 from 1 10000000:01000000:3.0:1789427704.138273:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789427704.138318:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 00000000a78ce675/0x2bea1a57ca3430ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.138326:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 00000000a78ce675/0x2bea1a57ca3430ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.138336:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 00000000a78ce675/0x2bea1a57ca3430ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427704.138358:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d7273fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042688:0@lo:101: 00000100:00100000:3.0:1789427704.138424:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427704.138456:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba67bd62 going to sleep for 11 seconds 00000100:00100000:1.0:1789427704.138572:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877042688 00000100:00100000:1.0:1789427704.138585:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877042688 00000100:00100000:1.0:1789427704.138625:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789427704.138633:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd102d9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:5816:x1876350877042688:12345-0@lo:101: 00010000:00010000:1.0:1789427704.138645:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427704.138657:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006608b159/0x2bea1a57ca3430b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3430ac expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.138679:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006608b159/0x2bea1a57ca3430b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3430ac expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.138689:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006608b159/0x2bea1a57ca3430b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3430ac expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.138697:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006608b159, rc 0) 00000100:00100000:1.0:1789427704.138737:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd102d9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5816:x1876350877042688:12345-0@lo:101: Request processed in 105us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427704.138744:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789427704.138895:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d7273fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042688:0@lo:101: 00010000:00010000:1.0:1789427704.138910:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 00000000a78ce675/0x2bea1a57ca3430ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.138918:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 00000000a78ce675/0x2bea1a57ca3430ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427704.138967:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e41c97cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042816:0@lo:501: 00000100:00100000:1.0:1789427704.138993:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427704.139013:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3fa837a going to sleep for 11 seconds 00000100:00100000:2.0:1789427704.139112:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877042816 00000100:00100000:2.0:1789427704.139117:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877042816 00000100:00100000:2.0:1789427704.139147:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789427704.139154:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b33f573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5816:x1876350877042816:12345-0@lo:501: 00000100:00100000:2.0:1789427704.139452:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b33f573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5816:x1876350877042816:12345-0@lo:501: Request processed in 298us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427704.139459:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789427704.139537:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e41c97cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042816:0@lo:501: 00000100:00100000:1.0:1789427704.139575:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e41c97cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042944:0@lo:503: 00000100:00100000:1.0:1789427704.139612:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427704.139632:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3fa837a going to sleep for 11 seconds 00000100:00100000:1.0:1789427704.139645:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877042944 00000100:00100000:1.0:1789427704.139649:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877042944 00000100:00100000:1.0:1789427704.139666:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789427704.139671:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000231abbd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5816:x1876350877042944:12345-0@lo:503: 00000100:00100000:1.0:1789427704.140125:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000231abbd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5816:x1876350877042944:12345-0@lo:503: Request processed in 453us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427704.140132:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789427704.146435:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e41c97cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877042944:0@lo:503: 00000100:00100000:3.0:1789427704.148074:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a0ba22c pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5862:1876350877043072:0@lo:502: 00000100:00100000:3.0:1789427704.148161:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427704.148239:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad488a79 going to sleep for 11 seconds 00000100:00100000:2.0:1789427704.148373:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877043072 00000100:00100000:2.0:1789427704.148392:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877043072 00000100:00100000:2.0:1789427704.148442:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789427704.148451:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014b3c581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5862:x1876350877043072:12345-0@lo:502: 00000100:00100000:2.0:1789427704.148746:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014b3c581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5862:x1876350877043072:12345-0@lo:502: Request processed in 295us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427704.148760:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789427704.148976:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a0ba22c pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5862:1876350877043072:0@lo:502: 00000020:01000004:0.0:1789427704.149054:0:5862:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789427704.149079:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ba1095df) 00000020:00000080:0.0:1789427704.149097:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789427704.149201:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d28f91fc from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789427704.149205:0:5862:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d28f91fc from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789427704.149208:0:5862:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d28f91fc 4 00010000:00080000:0.0:1789427704.149236:0:5862:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b5970e34@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.155@tcp at head 00010000:00010000:0.0:1789427704.152538:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789427704.152877:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789427704.152918:0:5862:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789427704.152933:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2bea1a57ca3430c1 00000100:00080000:0.0:1789427704.152943:0:5862:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789427704.152954:0:5862:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b5970e34 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789427704.153007:0:5862:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b6d5570c x1876350877043200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427704.153141:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6d5570c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877043200:0@lo:38: 00000100:00100000:2.0:1789427704.153227:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427704.153370:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877043200 00000100:00100000:1.0:1789427704.153393:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877043200 00000100:00100000:1.0:1789427704.153427:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427704.153434:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c81437a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876350877043200:12345-0@lo:38: 00000100:00080000:0.0:1789427704.153513:0:5862:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789427704.157361:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c01a8d26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5862:1876350877043328:0@lo:502: 00000100:00100000:0.0:1789427704.157521:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427704.157563:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba895efe going to sleep for 11 seconds 00000100:00100000:0.0:1789427704.157583:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877043328 00000100:00100000:0.0:1789427704.157591:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877043328 00000100:00100000:0.0:1789427704.157640:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789427704.157649:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cbb3b73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5862:x1876350877043328:12345-0@lo:502: 00000100:00100000:0.0:1789427704.159480:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cbb3b73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5862:x1876350877043328:12345-0@lo:502: Request processed in 1825us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427704.159494:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789427704.159644:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c01a8d26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5862:1876350877043328:0@lo:502: 00000040:00080000:0.0:1789427704.159680:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789427704.160064:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789427704.160090:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427704.160108:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 00000000a78ce675/0x2bea1a57ca3430ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427704.160123:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 00000000a78ce675/0x2bea1a57ca3430ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789427704.160218:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789427704.160223:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789427704.160225:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427704.160226:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427704.160228:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427704.160234:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427704.160235:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789427704.160236:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789427704.160237:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427704.160238:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427704.160239:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427704.160240:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427704.160244:0:5816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789427704.160249:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789427704.160250:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789427704.160251:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427704.160252:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427704.160253:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427704.160254:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427704.160255:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789427704.160256:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789427704.160257:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427704.160258:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427704.160259:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427704.160260:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427704.160284:0:5816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789427704.160312:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c01a8d26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877043456:0@lo:253: 00000100:00100000:0.0:1789427704.160356:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427704.160566:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c81437a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876350877043200:12345-0@lo:38: Request processed in 7131us (7338us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789427704.160579:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789427704.162392:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba895efe going to sleep for 11 seconds 00000100:00100000:0.0:1789427704.162437:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877043456 00000100:00100000:0.0:1789427704.162446:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877043456 00000100:00100000:0.0:1789427704.162501:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789427704.162509:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009cd74e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5816:x1876350877043456:12345-0@lo:253: 20000000:01000000:0.0:1789427704.162548:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789427704.162562:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789427704.165020:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789427704.165033:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000b5970e34 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789427704.165040:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789427704.165044:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6d5570c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877043200:0@lo:38: 20000000:01000000:3.0:1789427704.212815:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789427704.212839:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789427704.213007:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789427704.213012:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789427704.213032:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427704.213051:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343090 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427704.213077:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427704.213120:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343090 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427704.213134:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343090 expref: 12 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427704.213148:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f086b6ff pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1876350877043584:0@lo:104: 00000100:00100000:0.0:1789427704.213246:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427704.213311:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set 00000000535eb2af going to sleep for 11 seconds 00000100:00100000:1.0:1789427704.213451:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877043584 00000100:00100000:1.0:1789427704.213462:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877043584 00000100:00100000:1.0:1789427704.213512:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427704.213520:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000893198da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5850:x1876350877043584:12345-0@lo:104: 00010000:00010000:1.0:1789427704.213534:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.213590:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427704.213595:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000893198da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5850:x1876350877043584:12345-0@lo:104: Request processed in 76us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427704.213602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789427704.213632:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427704.213637:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.213645:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002cf996ca already unused, calling callback (00000000cd218a5f) 10000000:00010000:1.0:1789427704.213647:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.213655:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427704.213661:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427704.213666:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427704.213693:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.213700:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427704.213717:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.213724:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: 000000002cf996ca/0x2bea1a57ca343090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343097 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.213738:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427704.213740:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427704.213742:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427704.213941:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4b641f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877043712:0@lo:103: 00000100:00100000:1.0:1789427704.213972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427704.214055:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f086b6ff pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1876350877043584:0@lo:104: 00010000:00010000:1.0:1789427704.214084:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427704.214146:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877043712 00000100:00100000:3.0:1789427704.214151:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877043712 00010000:00010000:3.0:1789427704.214170:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343090 expref: 13 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427704.214226:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427704.214233:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000232e77bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:3299:x1876350877043712:12345-0@lo:103: 00010000:00010000:3.0:1789427704.214244:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427704.214248:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343090 expref: 13 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214257:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343090 expref: 13 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214268:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c4158e3f/0x2bea1a57ca343097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343090 expref: 13 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214282:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214303:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789427704.214328:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001315950s 00010000:00010000:3.0:1789427704.214332:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214338:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214343:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214348:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214352:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a5b98f39 already unused, calling callback (0000000072ecadce) 00010000:00010000:3.0:1789427704.214355:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214361:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214371:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427704.214380:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427704.214412:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000232e77bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:3299:x1876350877043712:12345-0@lo:103: Request processed in 180us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427704.214419:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427704.214513:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4b641f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877043712:0@lo:103: 00010000:00010000:1.0:1789427704.214534:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.214540:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427704.214545:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a5b98f39/0x2bea1a57ca3430c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427704.223552:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009cd74e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:5816:x1876350877043456:12345-0@lo:253: Request processed in 61036us (63188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427704.223570:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789427704.223661:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c01a8d26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5816:1876350877043456:0@lo:253: 10000000:01000000:0.0:1789427704.223679:0:5816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789427704.223682:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789427704.223684:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789427704.223685:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427704.223687:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427704.223688:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427704.223689:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427704.223690:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789427704.223692:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789427704.223693:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427704.223695:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427704.223696:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427704.223697:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789427704.223711:0:5816:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789427704.230325:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427704.230946:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427704.231386:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427704.231576:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427704.232587:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427704.232975:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427704.234117:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427704.234373:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427704.234576:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427704.234751:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427704.234966:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427704.235162:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789427704.287322:0:5816:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789427704.340586:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789427704.342637:0:5867:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789427704.342646:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789427704.343235:0:5868:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789427704.356278:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789427704.356686:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789427704.359062:0:5816:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789427704.359084:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789427704.359458:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789427704.360385:0:5816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789427704.360897:0:5816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789427704.360925:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789427704.361210:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789427704.364063:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1789427704.371054:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789427704.372320:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789427704.372504:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789427704.372662:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789427704.375234:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789427704.375483:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789427704.375654:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789427704.375820:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789427704.375969:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789427704.376113:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789427704.376315:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789427704.376458:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789427704.376625:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789427704.376798:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789427704.376956:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789427704.377087:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789427704.377454:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789427704.377603:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789427704.377751:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789427704.377890:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789427704.378046:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789427704.378262:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789427704.379646:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789427704.379821:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789427704.379972:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789427704.380114:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789427704.380334:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789427704.380519:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789427704.380690:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789427704.380857:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789427704.381027:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789427704.381236:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789427704.381446:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789427704.409914:0:5868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789427704.513847:0:5816:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789427704.513888:0:5816:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9e6b41b83988 00100000:10000000:2.0:1789427704.513897:0:5816:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789427704.516931:0:5816:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789427704.516950:0:5816:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789427704.516966:0:5816:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789427704.516985:0:5816:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789427704.601741:0:5868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789427704.601840:0:5868:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789427704.601846:0:5868:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789427705.034224:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427706.057346:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427707.082374:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427708.108668:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789427708.651603:0:6111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789427709.130274:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427709.389596:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c68f87b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877043840:0@lo:400: 00000100:00100000:3.0:1789427709.389669:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427709.389758:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877043840 00000100:00100000:0.0:1789427709.389767:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877043840 00000100:00100000:0.0:1789427709.389816:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789427709.389824:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a423843e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:3300:x1876350877043840:12345-0@lo:400: 00000100:00080000:2.0:1789427709.390045:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789427709.390051:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789427709.390054:0:38:0:(import.c:65:import_set_state_nolock()) 00000000b5970e34 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427709.390063:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b5970e34 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:2.0:1789427709.390087:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000060ec08c8 x1876350877043968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427709.390128:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060ec08c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877043968:0@lo:38: 00000100:00100000:2.0:1789427709.390157:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427709.390244:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877043968 00000100:00100000:2.0:1789427709.390249:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877043968 00000100:00100000:2.0:1789427709.390271:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427709.390275:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002db01ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876350877043968:12345-0@lo:38: 00010000:00080000:2.0:1789427709.390295:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1789427709.390330:0:5836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2bea1a57ca3430cf 00000004:00100000:2.0:1789427709.390439:0:5836:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789427709.390578:0:5836:0:(import.c:65:import_set_state_nolock()) 00000000c6516dbb : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427709.390620:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002db01ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876350877043968:12345-0@lo:38: Request processed in 342us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427709.390628:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789427709.390667:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000060ec08c8 x1876350877043968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789427709.390683:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789427709.390689:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789427709.390693:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789427709.390695:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000b5970e34 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789427709.390700:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060ec08c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877043968:0@lo:38: 00000100:00100000:0.0:1789427709.400631:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a423843e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:3300:x1876350877043840:12345-0@lo:400: Request processed in 10802us (10957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427709.400645:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789427709.400762:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c68f87b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877043840:0@lo:400: 00010000:00010000:2.0:1789427710.153858:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427711.178435:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427712.204384:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789427712.461287:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789427712.461296:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933433d9c800 from 3 10000000:01000000:0.0:1789427712.461301:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789427712.461346:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 0000000031e8ba85/0x2bea1a57ca3430d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427712.461359:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 0000000031e8ba85/0x2bea1a57ca3430d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427712.461370:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 0000000031e8ba85/0x2bea1a57ca3430d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427712.461395:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c01a8d26 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877044096:0@lo:101: 00000100:00100000:0.0:1789427712.461462:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427712.461509:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8792515 going to sleep for 11 seconds 00000100:00100000:2.0:1789427712.461661:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877044096 00000100:00100000:2.0:1789427712.461670:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877044096 00000100:00100000:2.0:1789427712.461727:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789427712.461736:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001029e51c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:5831:x1876350877044096:12345-0@lo:101: 00010000:00010000:2.0:1789427712.461750:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427712.461763:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e53e52b0/0x2bea1a57ca3430dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3430d6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427712.461786:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e53e52b0/0x2bea1a57ca3430dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3430d6 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427712.461796:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e53e52b0/0x2bea1a57ca3430dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3430d6 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427712.461805:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e53e52b0, rc 0) 00000100:00100000:2.0:1789427712.461866:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001029e51c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877044096:12345-0@lo:101: Request processed in 130us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427712.461873:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789427712.461969:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c01a8d26 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877044096:0@lo:101: 00010000:00010000:3.0:1789427712.461985:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 0000000031e8ba85/0x2bea1a57ca3430d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427712.461993:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 0000000031e8ba85/0x2bea1a57ca3430d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427712.462043:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3e096cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877044224:0@lo:256: 00000100:00100000:3.0:1789427712.462077:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427712.462104:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085b1412f going to sleep for 11 seconds 00000100:00100000:0.0:1789427712.462254:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877044224 00000100:00100000:0.0:1789427712.462259:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877044224 00000100:00100000:0.0:1789427712.462295:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789427712.462302:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3b6c3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877044224:12345-0@lo:256: 20000000:01000000:0.0:1789427712.462316:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789427712.462333:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789427712.462337:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789427712.462415:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3b6c3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877044224:12345-0@lo:256: Request processed in 114us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427712.462422:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789427712.462486:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3e096cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877044224:0@lo:256: 10000000:01000000:3.0:1789427712.462529:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789427712.462535:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: 0000000031e8ba85/0x2bea1a57ca3430d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427712.462542:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: 0000000031e8ba85/0x2bea1a57ca3430d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427713.226446:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789427713.523856:0:6312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecf7d6990 20000000:00000080:3.0:1789427713.523874:0:6312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93340ef3f000 uarg=0000000000000000 20000000:01000000:3.0:1789427713.523917:0:6312:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789427713.523924:0:6312:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789427713.523930:0:6312:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789427713.524386:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789427713.524398:0:6312:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789427713.533449:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427713.533765:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789427713.533831:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789427713.533883:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789427713.533902:0:6312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789427713.533922:0:6312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427713.533955:0:6312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34309e expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427713.533964:0:6312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427713.534002:0:6312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34309e expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427713.534017:0:6312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34309e expref: 11 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427713.534031:0:6312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3e096cb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1876350877044352:0@lo:104: 00000100:00100000:3.0:1789427713.534093:0:6312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427713.534207:0:6312:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053758565 going to sleep for 11 seconds 00000100:00100000:1.0:1789427713.534276:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877044352 00000100:00100000:1.0:1789427713.534286:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877044352 00000100:00100000:1.0:1789427713.534336:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789427713.534345:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000093bb2f21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:6312:x1876350877044352:12345-0@lo:104: 00010000:00010000:1.0:1789427713.534358:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534421:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427713.534426:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000093bb2f21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:6312:x1876350877044352:12345-0@lo:104: Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427713.534433:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789427713.534454:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427713.534459:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534467:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fc7207e already unused, calling callback (00000000cd218a5f) 10000000:00010000:1.0:1789427713.534470:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534477:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427713.534483:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427713.534488:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789427713.534517:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534531:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427713.534548:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534554:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: 000000008fc7207e/0x2bea1a57ca34309e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534572:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427713.534573:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427713.534575:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427713.534593:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4b641f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877044480:0@lo:103: 00000100:00100000:1.0:1789427713.534621:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427713.534664:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877044480 00000100:00100000:1.0:1789427713.534668:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877044480 00010000:00010000:1.0:1789427713.534683:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34309e expref: 12 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427713.534704:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789427713.534709:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e93bc98b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:3301:x1876350877044480:12345-0@lo:103: 00010000:00010000:1.0:1789427713.534718:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427713.534722:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34309e expref: 12 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534731:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34309e expref: 12 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534744:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534762:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534774:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534780:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534785:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534790:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534795:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e14f67d0 already unused, calling callback (0000000072ecadce) 00010000:00010000:1.0:1789427713.534799:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534805:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534813:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427713.534822:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427713.534850:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e93bc98b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:3301:x1876350877044480:12345-0@lo:103: Request processed in 141us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427713.534857:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789427713.534891:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4b641f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877044480:0@lo:103: 00010000:00010000:3.0:1789427713.537274:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000089c19055/0x2bea1a57ca3430a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34309e expref: 11 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427713.537298:0:6312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3e096cb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1876350877044352:0@lo:104: 00010000:00010000:3.0:1789427713.537340:0:6312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427713.537349:0:6312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427713.537355:0:6312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427713.537360:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e14f67d0/0x2bea1a57ca3430e4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427714.250454:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427714.506355:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877044736:0@lo:400: 00000100:00100000:2.0:1789427714.506427:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427714.506489:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427714.506495:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060ec08c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877044608:0@lo:400: 00000100:00100000:2.0:1789427714.506523:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427714.506558:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877044736 00000100:00100000:2.0:1789427714.506566:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877044736 00000100:00100000:2.0:1789427714.506613:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427714.506621:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc122935 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877044736:12345-0@lo:400: 00000100:00100000:2.0:1789427714.506670:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc122935 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877044736:12345-0@lo:400: Request processed in 50us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427714.506676:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789427714.506730:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fe787709 x1876350877044736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427714.506744:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877044736:0@lo:400: 00000100:00100000:0.0:1789427714.506962:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877044608 00000100:00100000:0.0:1789427714.506981:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877044608 00000100:00100000:0.0:1789427714.507019:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789427714.507025:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4f61ada pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:3299:x1876350877044608:12345-0@lo:400: 00000100:00100000:0.0:1789427714.507064:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4f61ada pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:3299:x1876350877044608:12345-0@lo:400: Request processed in 40us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427714.507069:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789427714.507123:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060ec08c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877044608:0@lo:400: 00010000:00010000:1.0:1789427715.273337:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427716.297333:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427717.321365:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789427717.540368:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789427717.540378:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933433d9c800 from 1 10000000:01000000:2.0:1789427717.540383:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789427717.540432:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: 00000000d122ff19/0x2bea1a57ca3430eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427717.540447:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: 00000000d122ff19/0x2bea1a57ca3430eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427717.540458:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: 00000000d122ff19/0x2bea1a57ca3430eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427717.540493:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877044864:0@lo:101: 00000100:00100000:2.0:1789427717.540577:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427717.540617:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877044864 00000100:00100000:2.0:1789427717.540625:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877044864 00000100:00100000:2.0:1789427717.540679:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789427717.540687:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000147e0ee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:5831:x1876350877044864:12345-0@lo:101: 00010000:00010000:2.0:1789427717.540702:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427717.540714:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008fc7207e/0x2bea1a57ca3430f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3430eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427717.540741:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008fc7207e/0x2bea1a57ca3430f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3430eb expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427717.540751:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008fc7207e/0x2bea1a57ca3430f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3430eb expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427717.540761:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008fc7207e, rc 0) 00000100:00100000:2.0:1789427717.540790:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000147e0ee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877044864:12345-0@lo:101: Request processed in 104us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427717.540796:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789427717.540846:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000042c2734 going to sleep for 11 seconds 00000100:00100000:2.0:1789427717.540868:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877044864:0@lo:101: 00010000:00010000:2.0:1789427717.540881:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: 00000000d122ff19/0x2bea1a57ca3430eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427717.540890:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: 00000000d122ff19/0x2bea1a57ca3430eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427717.540951:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877044992:0@lo:501: 00000100:00100000:2.0:1789427717.540972:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427717.540990:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877044992 00000100:00100000:2.0:1789427717.540993:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877044992 00000100:00100000:2.0:1789427717.541009:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789427717.541013:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081dab228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877044992:12345-0@lo:501: 00000100:00100000:2.0:1789427717.541303:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081dab228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877044992:12345-0@lo:501: Request processed in 289us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427717.541310:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789427717.541330:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000042c2734 going to sleep for 11 seconds 00000100:00100000:2.0:1789427717.541338:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877044992:0@lo:501: 00000100:00100000:2.0:1789427717.541361:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877045120:0@lo:503: 00000100:00100000:2.0:1789427717.541396:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427717.541412:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877045120 00000100:00100000:2.0:1789427717.541415:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877045120 00000100:00100000:2.0:1789427717.541432:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789427717.541437:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000604eec73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877045120:12345-0@lo:503: 00000100:00100000:2.0:1789427717.541578:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000604eec73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877045120:12345-0@lo:503: Request processed in 142us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427717.541585:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789427717.541609:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000042c2734 going to sleep for 11 seconds 00000100:00100000:2.0:1789427717.541618:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877045120:0@lo:503: 00000100:00100000:2.0:1789427717.541792:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6549:1876350877045248:0@lo:502: 00000100:00100000:2.0:1789427717.541821:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427717.541841:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877045248 00000100:00100000:2.0:1789427717.541844:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877045248 00000100:00100000:2.0:1789427717.541859:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789427717.541864:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000656b8994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6549:x1876350877045248:12345-0@lo:502: 00000100:00100000:2.0:1789427717.541974:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000656b8994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6549:x1876350877045248:12345-0@lo:502: Request processed in 110us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427717.541980:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789427717.542003:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set 00000000449657d1 going to sleep for 11 seconds 00000100:00100000:2.0:1789427717.542012:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe787709 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6549:1876350877045248:0@lo:502: 00000020:01000000:2.0:1789427717.542030:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427717.542040:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427717.542042:0:6549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789427717.548632:0:6549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933433d9c800 00000020:00000080:2.0:1789427717.549408:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789427717.549499:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6549:1876350877045376:0@lo:502: 00000100:00100000:2.0:1789427717.549603:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427717.549650:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877045376 00000100:00100000:2.0:1789427717.549658:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877045376 00000100:00100000:2.0:1789427717.549707:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789427717.549717:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6549:x1876350877045376:12345-0@lo:502: 00000100:00100000:2.0:1789427717.549958:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6549:x1876350877045376:12345-0@lo:502: Request processed in 241us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427717.549967:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789427717.550020:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341105ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427717.550041:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6549:1876350877045376:0@lo:502: 00000020:01000000:2.0:1789427717.550082:0:6549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427717.550089:0:6549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427717.550091:0:6549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789427717.550100:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789427717.550170:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789427717.550205:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427717.550215:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427717.550229:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427718.369266:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427719.369421:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427719.636767:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877045632:0@lo:400: 00000100:00100000:0.0:1789427719.636864:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427719.636921:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427719.636928:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877045504:0@lo:400: 00000100:00100000:0.0:1789427719.636959:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427719.636997:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877045504 00000100:00100000:0.0:1789427719.637006:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877045504 00000100:00100000:0.0:1789427719.637082:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427719.637092:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:3301:x1876350877045504:12345-0@lo:400: 00000100:00100000:0.0:1789427719.637142:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:3301:x1876350877045504:12345-0@lo:400: Request processed in 51us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427719.637150:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427719.637218:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877045504:0@lo:400: 00000100:00100000:2.0:1789427719.641120:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877045632 00000100:00100000:2.0:1789427719.641137:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877045632 00000100:00100000:2.0:1789427719.641206:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427719.641217:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877045632:12345-0@lo:400: 00000100:00100000:2.0:1789427719.641308:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877045632:12345-0@lo:400: Request processed in 94us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427719.641316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789427719.641364:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93343ae63800 x1876350877045632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427719.641378:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877045632:0@lo:400: 00010000:00010000:3.0:1789427720.394828:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789427720.864948:0:6680:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789427720.864953:0:6680:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789427720.865093:0:6680:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff933406156800 00000020:01000004:0.0:1789427720.865115:0:6680:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789427720.865130:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789427720.865146:0:6680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93341da2b380) 00000020:00000080:0.0:1789427720.865164:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789427720.881845:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789427720.882131:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789427720.905722:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789427720.909711:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789427720.909746:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789427720.909801:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789427720.909826:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789427720.910739:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789427720.910753:0:6680:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789427720.910777:0:6680:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bea1a57ca343100 00000020:01000004:2.0:1789427720.910788:0:6680:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789427720.910814:0:6680:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789427720.910818:0:6680:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789427720.910825:0:6680:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789427720.910830:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789427720.910844:0:6680:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9334101b4d40) 00000020:00000080:2.0:1789427720.910856:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789427720.912571:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427720.912773:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789427720.912780:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789427720.920558:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789427720.920570:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789427720.921198:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789427720.921207:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789427720.923457:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427720.923677:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789427720.923683:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789427720.924577:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789427720.924587:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789427720.939405:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427720.939699:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789427720.939708:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789427720.941006:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789427720.941019:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789427720.942109:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789427720.942130:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789427720.945459:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789427720.945710:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789427720.945717:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789427720.946231:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789427720.946239:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789427721.007863:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789427721.008272:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789427721.008282:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789427721.009562:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789427721.009573:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789427721.010066:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789427721.010094:0:6680:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789427721.010103:0:6680:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789427721.028035:0:6680:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789427721.028081:0:6680:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.155@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789427721.028084:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789427721.028086:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789427721.028087:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789427721.028088:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789427721.028089:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789427721.028090:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789427721.028091:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789427721.028093:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789427721.028093:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789427721.028095:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789427721.028096:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789427721.028100:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789427721.028102:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789427721.028103:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789427721.028103:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789427721.028104:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789427721.028104:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789427721.028105:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789427721.028106:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789427721.028106:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789427721.028107:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789427721.028108:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789427721.028109:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789427721.028143:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789427721.028276:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877045760:0@lo:253: 00000100:00100000:3.0:1789427721.028369:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427721.028465:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427721.028529:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877045760 00000100:00100000:2.0:1789427721.028538:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877045760 00000100:00100000:2.0:1789427721.028597:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789427721.028608:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877045760:12345-0@lo:253: 20000000:01000000:2.0:1789427721.028652:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789427721.028657:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789427721.028663:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789427721.028667:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789427721.029739:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789427721.029966:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789427721.029998:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789427721.030052:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789427721.030060:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789427721.030087:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789427721.030145:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1789427721.030805:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789427721.030828:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.155@tcp 20000000:01000000:2.0:1789427721.030831:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.155@tcp (null) (null) (null) 00000040:00080000:2.0:1789427721.030866:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789427721.030874:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789427721.030925:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789427721.030933:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.155@tcp (null) (null) 00000040:00080000:2.0:1789427721.030965:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789427721.030975:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789427721.031018:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789427721.031070:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789427721.031868:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789427721.031885:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.155@tcp 20000000:01000000:2.0:1789427721.031887:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.155@tcp (null) (null) (null) 00000040:00080000:2.0:1789427721.031918:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789427721.031924:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789427721.031951:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789427721.031958:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.155@tcp (null) (null) 00000040:00080000:2.0:1789427721.032011:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789427721.032020:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789427721.032050:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789427721.032081:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789427721.032097:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789427721.032100:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789427721.032108:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789427721.032110:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789427721.032119:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789427721.032135:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789427721.032139:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789427721.032267:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789427721.032271:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789427721.032916:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789427721.032970:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789427721.033032:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789427721.033860:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789427721.033900:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789427721.033974:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789427721.033996:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789427721.033998:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789427721.034843:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789427721.034899:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789427721.034945:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789427721.035450:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1789427721.035558:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1789427721.035598:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1789427721.035610:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789427721.035612:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789427721.036410:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789427721.036707:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789427721.036743:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789427721.036799:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1789427721.036818:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789427721.036844:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.036866:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343020 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.036875:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401491600/0x2bea1a57ca343043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34303c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.036882:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3430b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3430ac expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.036890:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.036952:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3430b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3430ac expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.036970:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3430b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3430ac expref: 12 pid: 5829 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427721.036997:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1876350877045888:0@lo:104: 00000100:00100000:2.0:1789427721.037081:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427721.037328:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401491600/0x2bea1a57ca343043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34303c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.037337:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933401491600/0x2bea1a57ca343043 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34303c expref: 12 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427721.037346:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1876350877046016:0@lo:104: 00000100:00100000:2.0:1789427721.037369:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427721.037458:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343020 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.037467:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343020 expref: 12 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427721.037476:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1876350877046144:0@lo:104: 00000100:00100000:2.0:1789427721.037581:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427721.037597:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877045888 00000100:00100000:1.0:1789427721.037606:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877045888 00000100:00100000:1.0:1789427721.037650:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877046016 00000100:00100000:1.0:1789427721.037653:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877046016 00000100:00100000:1.0:1789427721.037667:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427721.037675:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:5827:x1876350877045888:12345-0@lo:104: 00010000:00010000:1.0:1789427721.037690:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933401526e00/0x2bea1a57ca3430ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.037776:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427721.037782:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:5827:x1876350877045888:12345-0@lo:104: Request processed in 108us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.037789:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427721.037807:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427721.037813:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5827:x1876350877046016:12345-0@lo:104: 00010000:00010000:1.0:1789427721.037820:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff9334421c7200/0x2bea1a57ca34303c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.037894:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427721.037902:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933401526e00/0x2bea1a57ca3430ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.037909:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401526e00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427721.037915:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933401526e00/0x2bea1a57ca3430ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.037925:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401526e00/0x2bea1a57ca3430ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427721.037934:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401526e00/0x2bea1a57ca3430ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427721.037940:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427721.037979:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933401526e00/0x2bea1a57ca3430ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.037994:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427721.038017:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933401526e00/0x2bea1a57ca3430ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.038026:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401526e00/0x2bea1a57ca3430ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430b3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.038051:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427721.038054:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff9334421c7200/0x2bea1a57ca34303c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.038060:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c7200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427721.038063:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7200/0x2bea1a57ca34303c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.038071:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff9334421c7200/0x2bea1a57ca34303c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427721.038078:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7200/0x2bea1a57ca34303c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427721.038083:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427721.038096:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff9334421c7200/0x2bea1a57ca34303c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.038102:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427721.038107:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff9334421c7200/0x2bea1a57ca34303c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.038113:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff9334421c7200/0x2bea1a57ca34303c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343043 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.038123:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427721.038125:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427721.038127:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427721.038140:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877046272:0@lo:103: 00000100:00100000:0.0:1789427721.038205:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427721.038229:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427721.038234:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877046400:0@lo:103: 00000100:00100000:0.0:1789427721.038252:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427721.038472:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789427721.038479:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5827:x1876350877046016:12345-0@lo:104: Request processed in 666us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.038540:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427721.038560:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877046272 00000100:00100000:1.0:1789427721.038564:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877046272 00010000:00010000:1.0:1789427721.038584:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3430b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3430ac expref: 13 pid: 5829 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427721.038622:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877046400 00000100:00100000:1.0:1789427721.038626:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877046400 00010000:00010000:1.0:1789427721.038637:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401491600/0x2bea1a57ca343043 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34303c expref: 14 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427721.038651:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427721.038657:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3298:x1876350877046272:12345-0@lo:103: 00010000:00010000:1.0:1789427721.038668:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427721.038674:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3430b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3430ac expref: 14 pid: 5829 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.038686:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3430b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3430ac expref: 14 pid: 5829 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.038703:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427721.038734:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3298:x1876350877046272:12345-0@lo:103: Request processed in 77us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.038740:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427721.038752:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427721.038758:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:3298:x1876350877046400:12345-0@lo:103: 00010000:00010000:1.0:1789427721.038765:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427721.038769:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401491600/0x2bea1a57ca343043 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34303c expref: 13 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.038777:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401491600/0x2bea1a57ca343043 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34303c expref: 13 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.038786:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427721.038810:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:3298:x1876350877046400:12345-0@lo:103: Request processed in 52us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.038816:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427721.038850:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877046400:0@lo:103: 00000100:00100000:1.0:1789427721.038858:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877046272:0@lo:103: 00010000:00010000:3.0:1789427721.038927:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427721.039050:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789427721.039065:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3430b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3430ac expref: 12 pid: 5829 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427721.039076:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1876350877045888:0@lo:104: 00010000:00010000:2.0:1789427721.039094:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401491600/0x2bea1a57ca343043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34303c expref: 11 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427721.039105:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1876350877046016:0@lo:104: 00000100:00100000:3.0:1789427721.039139:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877046144 00000100:00100000:3.0:1789427721.039144:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877046144 00000100:00100000:3.0:1789427721.039383:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789427721.039392:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5827:x1876350877046144:12345-0@lo:104: 00010000:00010000:3.0:1789427721.039403:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933401527a00/0x2bea1a57ca343020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.039495:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789427721.039500:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5827:x1876350877046144:12345-0@lo:104: Request processed in 111us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427721.039504:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789427721.039532:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427721.039538:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933401527a00/0x2bea1a57ca343020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.039543:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401527a00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427721.039546:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933401527a00/0x2bea1a57ca343020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.039552:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401527a00/0x2bea1a57ca343020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427721.039556:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401527a00/0x2bea1a57ca343020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427721.039559:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427721.039586:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933401527a00/0x2bea1a57ca343020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.039593:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427721.039617:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933401527a00/0x2bea1a57ca343020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.039624:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401527a00/0x2bea1a57ca343020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343027 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.039640:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427721.039648:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427721.039649:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427721.039766:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1876350877046144:0@lo:104: 00010000:00010000:2.0:1789427721.039785:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427721.039801:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877046528:0@lo:103: 00000100:00100000:2.0:1789427721.039823:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427721.039887:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877046528 00000100:00100000:1.0:1789427721.039891:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877046528 00010000:00010000:1.0:1789427721.039903:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343020 expref: 11 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427721.039923:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789427721.039927:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:3300:x1876350877046528:12345-0@lo:103: 00010000:00010000:1.0:1789427721.039933:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427721.039935:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343020 expref: 11 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.039942:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343020 expref: 11 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.039950:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343020 expref: 11 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.039960:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.039966:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.039979:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.040002:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.040009:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.040016:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.040022:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02ae00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789427721.040027:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.040035:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.040049:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.040055:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427721.040077:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:3300:x1876350877046528:12345-0@lo:103: Request processed in 149us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.040081:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789427721.040099:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877046528:0@lo:103: 00010000:00010000:1.0:1789427721.040111:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.040116:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.040127:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca34310e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789427721.040136:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789427721.122122:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:6680:x1876350877045760:12345-0@lo:253: Request processed in 93508us (93744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427721.122137:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789427721.122155:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877045760:0@lo:253: 10000000:01000000:2.0:1789427721.122171:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789427721.122200:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789427721.122202:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789427721.122204:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789427721.122206:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789427721.122207:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789427721.122209:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789427721.122210:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789427721.122212:0:6680:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789427721.122213:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789427721.122214:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789427721.122397:0:6680:0:(tgt_mount.c:101:server_register_mount()) register mount ffff933406156800 from lustre-OST0000 10000000:01000000:2.0:1789427721.122421:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789427721.122424:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789427721.122430:0:6680:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9334101b3380 local copy 10000000:01000000:2.0:1789427721.122434:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789427721.122471:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.122480:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.122568:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427721.122587:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877046656:0@lo:101: 00000100:00100000:2.0:1789427721.122691:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427721.122787:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427721.122850:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877046656 00000100:00100000:0.0:1789427721.122857:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877046656 00000100:00100000:0.0:1789427721.122903:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789427721.122912:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:6680:x1876350877046656:12345-0@lo:101: 00010000:00010000:0.0:1789427721.122925:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427721.122937:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400030400/0x2bea1a57ca34311c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343115 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.122959:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030400/0x2bea1a57ca34311c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343115 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.122970:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400030400/0x2bea1a57ca34311c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343115 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.122980:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030400, rc 0) 00000100:00100000:0.0:1789427721.123024:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:6680:x1876350877046656:12345-0@lo:101: Request processed in 114us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427721.123030:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789427721.124064:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877046656:0@lo:101: 00010000:00010000:3.0:1789427721.124080:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.124087:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427721.124244:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877046784:0@lo:501: 00000100:00100000:3.0:1789427721.124285:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427721.124321:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427721.124333:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877046784 00000100:00100000:1.0:1789427721.124339:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877046784 00000100:00100000:1.0:1789427721.124380:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789427721.124388:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:6680:x1876350877046784:12345-0@lo:501: 00000100:00100000:1.0:1789427721.124634:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:6680:x1876350877046784:12345-0@lo:501: Request processed in 245us (347us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427721.124643:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789427721.125022:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877046784:0@lo:501: 10000000:01000000:3.0:1789427721.125039:0:6680:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789427721.125071:0:6680:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789427721.125077:0:6680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.125087:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.125107:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.125140:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789427721.125165:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933406156800 10000000:01000000:3.0:1789427721.125171:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789427721.125335:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427721.125343:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.125436:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789427721.125441:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.125452:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427721.125460:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427721.125466:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427721.125492:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.125499:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789427721.125551:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877046912:0@lo:103: 00000100:00100000:0.0:1789427721.125595:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427721.125683:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877046912 00000100:00100000:1.0:1789427721.125691:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877046912 00000100:00100000:1.0:1789427721.125734:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427721.125743:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:3301:x1876350877046912:12345-0@lo:103: 00010000:00010000:1.0:1789427721.125754:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427721.125769:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400030400/0x2bea1a57ca34311c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca343115 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.125788:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427721.125836:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.125844:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bea1a57ca34311c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.125864:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427721.125865:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427721.125867:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789427721.125932:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9334101b3380 10000000:01000000:3.0:1789427721.125948:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789427721.125952:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9334101b3380 from 1 10000000:01000000:3.0:1789427721.125956:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789427721.125977:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.125997:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.126007:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427721.126023:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047040:0@lo:101: 00000100:00100000:3.0:1789427721.126054:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427721.126079:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427721.126242:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877047040 00000100:00100000:2.0:1789427721.126246:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877047040 00000100:00100000:2.0:1789427721.126276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789427721.126283:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+10:6680:x1876350877047040:12345-0@lo:101: 00010000:00010000:2.0:1789427721.126292:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427721.126303:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02a800/0x2bea1a57ca34312a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343123 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.126321:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02a800/0x2bea1a57ca34312a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343123 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.126332:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02a800/0x2bea1a57ca34312a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343123 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.126338:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a800, rc 0) 00000100:00100000:2.0:1789427721.126385:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:6680:x1876350877047040:12345-0@lo:101: Request processed in 102us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427721.126391:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789427721.126554:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047040:0@lo:101: 00010000:00010000:3.0:1789427721.126567:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34312a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.126577:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34312a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427721.126608:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789427721.126625:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34312a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.126632:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34312a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427721.126639:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789427721.126642:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789427721.126646:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789427721.126649:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789427721.126664:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.126673:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.126681:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427721.126693:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047168:0@lo:101: 00000100:00100000:3.0:1789427721.126717:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427721.126738:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427721.126752:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877047168 00000100:00100000:3.0:1789427721.126756:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877047168 00000100:00100000:3.0:1789427721.126781:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789427721.126789:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:6680:x1876350877047168:12345-0@lo:101: 00010000:00010000:3.0:1789427721.126796:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427721.126811:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343131 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.126826:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343131 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.126835:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343131 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.126842:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401526000, rc 0) 00000100:00100000:3.0:1789427721.126872:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047168:12345-0@lo:101: Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427721.126878:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789427721.126913:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047168:0@lo:101: 00010000:00010000:3.0:1789427721.127043:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.127051:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427721.127157:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047296:0@lo:501: 00000100:00100000:3.0:1789427721.127222:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427721.127239:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427721.127306:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877047296 00000100:00100000:2.0:1789427721.127311:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877047296 00000100:00100000:2.0:1789427721.127341:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789427721.127356:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047296:12345-0@lo:501: 00000100:00100000:2.0:1789427721.127581:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047296:12345-0@lo:501: Request processed in 233us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427721.127598:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789427721.127831:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047296:0@lo:501: 00000100:00100000:3.0:1789427721.127866:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047424:0@lo:503: 00000100:00100000:3.0:1789427721.128040:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427721.128076:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427721.128134:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877047424 00000100:00100000:2.0:1789427721.128139:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877047424 00000100:00100000:2.0:1789427721.128201:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789427721.128210:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047424:12345-0@lo:503: 00000100:00100000:2.0:1789427721.128520:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047424:12345-0@lo:503: Request processed in 310us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427721.128527:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789427721.128661:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047424:0@lo:503: 00000040:00080000:3.0:1789427721.128979:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789427721.129060:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047552:0@lo:502: 00000100:00100000:3.0:1789427721.129103:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427721.129140:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427721.129291:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877047552 00000100:00100000:2.0:1789427721.129297:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877047552 00000100:00100000:2.0:1789427721.129322:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789427721.129328:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047552:12345-0@lo:502: 00000100:00100000:2.0:1789427721.129491:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047552:12345-0@lo:502: Request processed in 162us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427721.129498:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789427721.129824:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047552:0@lo:502: 00000040:00080000:3.0:1789427721.130135:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789427721.130228:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789427721.130266:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789427721.130328:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789427721.130573:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789427721.130613:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789427721.130648:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047680:0@lo:502: 00000100:00100000:3.0:1789427721.130698:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427721.130808:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:3301:x1876350877046912:12345-0@lo:103: Request processed in 5065us (5210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.130820:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427721.130896:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789427721.132585:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877046912:0@lo:103: 00000100:00100000:2.0:1789427721.132710:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877047680 00000100:00100000:2.0:1789427721.132719:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877047680 00000100:00100000:2.0:1789427721.132821:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789427721.132833:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:6680:x1876350877047680:12345-0@lo:502: 00000100:00100000:2.0:1789427721.133130:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:6680:x1876350877047680:12345-0@lo:502: Request processed in 299us (2431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427721.133138:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789427721.133233:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047680:0@lo:502: 00000040:00080000:0.0:1789427721.133399:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789427721.133414:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1789427721.134302:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789427721.134312:0:6701:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789427721.134324:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427721.134327:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789427721.134333:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789427721.134357:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93341da28000) 00000020:00000080:0.0:1789427721.134379:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789427721.134387:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789427721.134468:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933406156800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789427721.134475:0:6701:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789427721.134483:0:6701:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bea1a57ca343146 00010000:00010000:0.0:1789427721.145685:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789427721.146566:0:6701:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789427721.152043:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789427721.154736:0:6701:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789427721.163962:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789427721.165461:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789427721.168925:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789427721.168938:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427721.168944:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427721.168946:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789427721.168950:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427721.168954:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427721.168956:0:6701:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789427721.168959:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789427721.168961:0:6701:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789427721.169033:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427721.169038:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427721.169039:0:6701:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789427721.169042:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789427721.179147:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789427721.179216:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789427721.179236:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.179370:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427721.179379:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933406156800 from 1 10000000:01000000:0.0:1789427721.179382:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789427721.179421:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.179429:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.179440:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427721.179464:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047808:0@lo:101: 00000100:00100000:0.0:1789427721.179666:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427721.181209:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341066c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427721.182094:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877047808 00000100:00100000:3.0:1789427721.182110:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877047808 00000100:00100000:3.0:1789427721.184788:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789427721.184821:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:6680:x1876350877047808:12345-0@lo:101: 00010000:00010000:3.0:1789427721.184846:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427721.184870:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34314d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.184907:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34314d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.184919:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34314d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427721.184930:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401526600, rc 0) 00000100:00100000:3.0:1789427721.185052:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047808:12345-0@lo:101: Request processed in 247us (5386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427721.185060:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789427721.186042:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047808:0@lo:101: 00010000:00010000:0.0:1789427721.186072:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.186083:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427721.186467:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047936:0@lo:501: 00000100:00100000:0.0:1789427721.186828:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427721.186875:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341066c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427721.186996:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877047936 00000100:00100000:3.0:1789427721.187004:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877047936 00000100:00100000:2.0:1789427721.187129:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789427721.187140:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047936:12345-0@lo:501: 00000100:00100000:2.0:1789427721.187655:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877047936:12345-0@lo:501: Request processed in 515us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427721.187673:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789427721.187774:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877047936:0@lo:501: 00000100:00100000:3.0:1789427721.187834:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048064:0@lo:503: 00000100:00100000:3.0:1789427721.187877:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427721.187910:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789427721.188096:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877048064 00000100:00100000:0.0:1789427721.188102:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877048064 00000100:00100000:0.0:1789427721.188142:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789427721.188151:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877048064:12345-0@lo:503: 00000100:00100000:0.0:1789427721.188642:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877048064:12345-0@lo:503: Request processed in 490us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427721.188651:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789427721.189432:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048064:0@lo:503: 00000040:00080000:3.0:1789427721.189786:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789427721.189867:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048192:0@lo:502: 00000100:00100000:3.0:1789427721.189925:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427721.190019:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789427721.190946:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877048192 00000100:00100000:0.0:1789427721.190956:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877048192 00000100:00100000:0.0:1789427721.191019:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789427721.191028:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877048192:12345-0@lo:502: 00000100:00100000:1.0:1789427721.191703:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877048192:12345-0@lo:502: Request processed in 673us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.191713:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789427721.191819:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048192:0@lo:502: 00000040:00080000:2.0:1789427721.192144:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789427721.192258:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789427721.192293:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048320:0@lo:502: 00000100:00100000:2.0:1789427721.192334:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427721.192601:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427721.192680:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877048320 00000100:00100000:0.0:1789427721.192690:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877048320 00000100:00100000:0.0:1789427721.192734:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789427721.192743:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877048320:12345-0@lo:502: 00000100:00100000:0.0:1789427721.192910:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877048320:12345-0@lo:502: Request processed in 167us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427721.192923:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789427721.193036:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048320:0@lo:502: 00000040:00080000:2.0:1789427721.193134:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789427721.193143:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789427721.193948:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427721.193960:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427721.193963:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789427721.193971:0:6705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933406156800 00000020:00000080:0.0:1789427721.193973:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789427721.194005:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427721.194009:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427721.194011:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789427721.194014:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789427721.194146:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789427721.194170:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427721.194226:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.194436:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427721.194569:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789427721.194573:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933406156800 10000000:01000000:2.0:1789427721.194576:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933406156800 10000000:01000000:2.0:1789427721.194581:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789427721.194587:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933406156800 from 1 10000000:01000000:2.0:1789427721.194590:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789427721.194625:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.194633:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.194653:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427721.194674:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048448:0@lo:101: 00000100:00100000:2.0:1789427721.194734:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427721.194781:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427721.194886:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877048448 00000100:00100000:1.0:1789427721.194894:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877048448 00000100:00100000:1.0:1789427721.194939:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789427721.194949:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877048448:12345-0@lo:101: 00010000:00010000:1.0:1789427721.194961:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427721.194975:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34315b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.195008:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34315b expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.195019:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34315b expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.195040:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7c00, rc 0) 00000100:00100000:1.0:1789427721.195088:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877048448:12345-0@lo:101: Request processed in 141us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.195095:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789427721.195227:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048448:0@lo:101: 00010000:00010000:2.0:1789427721.195431:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427721.195442:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427721.195625:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048576:0@lo:501: 00000100:00100000:2.0:1789427721.195672:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427721.195700:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427721.195759:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877048576 00000100:00100000:1.0:1789427721.195764:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877048576 00000100:00100000:1.0:1789427721.195795:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789427721.195801:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877048576:12345-0@lo:501: 00000100:00100000:1.0:1789427721.196022:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877048576:12345-0@lo:501: Request processed in 221us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.196029:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789427721.196115:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048576:0@lo:501: 00000100:00100000:2.0:1789427721.196142:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048704:0@lo:503: 00000100:00100000:2.0:1789427721.196207:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427721.196227:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427721.196437:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877048704 00000100:00100000:1.0:1789427721.196442:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877048704 00000100:00100000:1.0:1789427721.196565:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789427721.196572:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877048704:12345-0@lo:503: 00000100:00100000:1.0:1789427721.196737:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877048704:12345-0@lo:503: Request processed in 165us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.196744:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789427721.196881:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048704:0@lo:503: 00000040:00080000:2.0:1789427721.197449:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789427721.197620:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048832:0@lo:502: 00000100:00100000:2.0:1789427721.197672:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427721.197705:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427721.197796:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877048832 00000100:00100000:1.0:1789427721.197802:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877048832 00000100:00100000:1.0:1789427721.197837:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789427721.197844:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877048832:12345-0@lo:502: 00000100:00100000:1.0:1789427721.198049:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877048832:12345-0@lo:502: Request processed in 204us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.198057:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789427721.198432:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048832:0@lo:502: 00000040:00080000:2.0:1789427721.198807:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789427721.198866:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789427721.198903:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789427721.198951:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789427721.199002:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789427721.199051:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789427721.199087:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789427721.199122:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789427721.199929:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789427721.200010:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789427721.200050:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789427721.200131:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789427721.200168:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789427721.200590:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789427721.200648:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789427721.200685:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789427721.200722:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789427721.200775:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789427721.200808:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789427721.200834:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789427721.200871:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789427721.200899:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789427721.200927:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789427721.200974:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789427721.201024:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789427721.201059:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789427721.201128:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789427721.201582:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1789427721.201638:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048960:0@lo:502: 00000100:00100000:2.0:1789427721.201718:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427721.201815:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427721.201863:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877048960 00000100:00100000:1.0:1789427721.201878:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877048960 00000100:00100000:1.0:1789427721.201978:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789427721.201998:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877048960:12345-0@lo:502: 00000100:00100000:1.0:1789427721.202781:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877048960:12345-0@lo:502: Request processed in 791us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.202790:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789427721.202877:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877048960:0@lo:502: 00000040:00080000:2.0:1789427721.202980:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789427721.203005:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789427721.203776:0:6706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789427721.203792:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9334101b19c0) 00000020:00000080:2.0:1789427721.203813:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789427721.203902:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933406156800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789427721.203907:0:6706:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933406156800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789427721.203910:0:6706:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933406156800 3 00010000:00080000:2.0:1789427721.203937:0:6706:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333012a6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.155@tcp at head 00010000:00010000:2.0:1789427721.207645:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789427721.208726:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789427721.208763:0:6706:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789427721.208774:0:6706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2bea1a57ca343170 00000100:00080000:2.0:1789427721.208785:0:6706:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789427721.208796:0:6706:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9333012a6800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:2.0:1789427721.208832:0:6706:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933420ed2300 x1876350877049088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789427721.208902:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876350877049088:0@lo:38: 00000100:00100000:0.0:1789427721.208972:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427721.209065:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877049088 00000100:00100000:2.0:1789427721.209075:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877049088 00000100:00100000:2.0:1789427721.209107:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427721.209115:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876350877049088:12345-0@lo:38: 00010000:00080000:2.0:1789427721.209139:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:2.0:1789427721.209167:0:5836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2bea1a57ca343177 00000100:00080000:3.0:1789427721.211312:0:6706:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000004:00100000:2.0:1789427721.212473:0:5836:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789427721.212542:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9333012a6000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1789427721.213896:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789427721.215464:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789427721.215641:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427721.215660:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.215674:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789427721.215740:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789427721.215742:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789427721.215743:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427721.215745:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427721.215746:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427721.215747:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427721.215749:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427721.215750:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427721.215751:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427721.215753:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427721.215754:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427721.215758:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789427721.215766:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789427721.215767:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789427721.215768:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427721.215769:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427721.215770:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427721.215771:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427721.215772:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427721.215773:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427721.215774:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427721.215775:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427721.215775:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427721.215804:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789427721.215823:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877049216:0@lo:253: 00000100:00100000:0.0:1789427721.215904:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427721.215953:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341066c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789427721.215972:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877049216 00000100:00100000:0.0:1789427721.215979:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877049216 00000100:00100000:0.0:1789427721.216041:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789427721.216051:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6680:x1876350877049216:12345-0@lo:253: 20000000:01000000:0.0:1789427721.216078:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789427721.216092:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789427721.218649:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1876350877049088:12345-0@lo:38: Request processed in 9524us (9669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427721.218669:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427721.218767:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877049344:0@lo:400: 00000100:00100000:2.0:1789427721.218819:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427721.218857:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877049344 00000100:00100000:2.0:1789427721.218864:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877049344 00000100:00100000:2.0:1789427721.218896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427721.218902:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877049344:12345-0@lo:400: 00000100:00100000:2.0:1789427721.218961:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877049344:12345-0@lo:400: Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427721.218968:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789427721.219015:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff933420ed1f80 x1876350877049344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427721.219028:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877049344:0@lo:400: 00010000:00080000:0.0:1789427721.222313:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff933420ed2300 x1876350877049088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427721.222329:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789427721.222340:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789427721.222489:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789427721.222496:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789427721.222500:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9333012a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789427721.222507:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876350877049088:0@lo:38: 20000000:01000000:3.0:1789427721.261580:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789427721.261601:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789427721.262143:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789427721.262149:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789427721.262204:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.262223:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401490c00/0x2bea1a57ca3430dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3430d6 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.262231:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.262283:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401490c00/0x2bea1a57ca3430dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3430d6 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427721.262297:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933401490c00/0x2bea1a57ca3430dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3430d6 expref: 13 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427721.262310:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1876350877049472:0@lo:104: 00000100:00100000:0.0:1789427721.262520:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427721.262578:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341066c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789427721.263222:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877049472 00000100:00100000:1.0:1789427721.263233:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877049472 00000100:00100000:1.0:1789427721.263304:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789427721.263315:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5850:x1876350877049472:12345-0@lo:104: 00010000:00010000:1.0:1789427721.263331:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca3430d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263406:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427721.263412:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5850:x1876350877049472:12345-0@lo:104: Request processed in 101us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.263419:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789427721.263442:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427721.263448:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca3430d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263455:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427721.263460:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca3430d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263469:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca3430d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427721.263477:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca3430d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427721.263506:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427721.263541:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca3430d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263550:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427721.263569:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca3430d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263577:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca3430d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263593:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427721.263595:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427721.263597:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427721.263617:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877049600:0@lo:103: 00000100:00100000:1.0:1789427721.263656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427721.263701:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877049600 00000100:00100000:1.0:1789427721.263705:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877049600 00010000:00010000:1.0:1789427721.263723:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401490c00/0x2bea1a57ca3430dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3430d6 expref: 14 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427721.263745:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789427721.263751:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334081ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3299:x1876350877049600:12345-0@lo:103: 00010000:00010000:1.0:1789427721.263762:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427721.263767:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401490c00/0x2bea1a57ca3430dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3430d6 expref: 14 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263778:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401490c00/0x2bea1a57ca3430dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3430d6 expref: 14 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263802:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263811:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789427721.263827:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001678798s 00010000:00010000:1.0:1789427721.263832:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263840:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263848:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263856:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263862:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789427721.263867:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263875:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263885:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.263896:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427721.263927:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334081ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3299:x1876350877049600:12345-0@lo:103: Request processed in 176us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427721.263939:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789427721.264012:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877049600:0@lo:103: 00010000:00010000:1.0:1789427721.264039:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401490c00/0x2bea1a57ca3430dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3430d6 expref: 13 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427721.264050:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1876350877049472:0@lo:104: 00010000:00010000:1.0:1789427721.264063:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.264072:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.264077:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427721.264083:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400030800/0x2bea1a57ca34317e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427721.270854:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:6680:x1876350877049216:12345-0@lo:253: Request processed in 54795us (54940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427721.270870:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789427721.270997:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6680:1876350877049216:0@lo:253: 10000000:01000000:0.0:1789427721.271014:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789427721.271018:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789427721.271020:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789427721.271022:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427721.271023:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427721.271025:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427721.271026:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427721.271027:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789427721.271029:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789427721.271030:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789427721.271031:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427721.271033:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789427721.271051:0:6680:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789427721.274678:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789427721.274842:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789427721.275150:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789427721.275600:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789427721.275851:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789427721.276113:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789427721.278623:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789427721.422584:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789427721.529351:0:6680:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789427721.529358:0:6680:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789427721.529396:0:6680:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789427721.529459:0:6680:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789427721.529506:0:6680:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789427721.529527:0:6680:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789427722.441283:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427723.474741:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789427723.979354:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789427723.979362:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933433d9c800 from 21 10000000:01000000:2.0:1789427723.979368:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789427723.979419:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427723.979432:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427723.979444:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427723.979471:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877049728:0@lo:101: 00000100:00100000:2.0:1789427723.979573:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427723.979630:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b48d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427723.979707:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877049728 00000100:00100000:1.0:1789427723.979717:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877049728 00000100:00100000:1.0:1789427723.979785:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789427723.979795:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877049728:12345-0@lo:101: 00010000:00010000:1.0:1789427723.979808:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427723.979821:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343185 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427723.979856:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343185 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427723.979869:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343185 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427723.979878:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c6c00, rc 0) 00000100:00100000:1.0:1789427723.979928:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877049728:12345-0@lo:101: Request processed in 135us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427723.979944:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789427723.979977:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877049728:0@lo:101: 00010000:00010000:2.0:1789427723.979992:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427723.980000:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427723.980056:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877049856:0@lo:501: 00000100:00100000:2.0:1789427723.980096:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427723.980116:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b48d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427723.980163:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877049856 00000100:00100000:3.0:1789427723.980167:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877049856 00000100:00100000:3.0:1789427723.980216:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789427723.980224:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877049856:12345-0@lo:501: 00000100:00100000:3.0:1789427723.980569:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877049856:12345-0@lo:501: Request processed in 345us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427723.980586:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789427723.982001:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877049856:0@lo:501: 00000100:00100000:2.0:1789427723.982056:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877049984:0@lo:503: 00000100:00100000:2.0:1789427723.982129:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427723.982168:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b48d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427723.982277:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877049984 00000100:00100000:1.0:1789427723.982284:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877049984 00000100:00100000:1.0:1789427723.982323:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789427723.982332:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877049984:12345-0@lo:503: 00000100:00100000:1.0:1789427723.982676:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877049984:12345-0@lo:503: Request processed in 344us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427723.982685:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789427723.982733:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877049984:0@lo:503: 00000100:00100000:1.0:1789427723.982927:0:6832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6832:1876350877050112:0@lo:502: 00000100:00100000:1.0:1789427723.982970:0:6832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427723.982991:0:6832:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421ad9840 going to sleep for 11 seconds 00000100:00100000:3.0:1789427723.983128:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877050112 00000100:00100000:3.0:1789427723.983134:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877050112 00000100:00100000:3.0:1789427723.983168:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789427723.983243:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6832:x1876350877050112:12345-0@lo:502: 00000100:00100000:3.0:1789427723.983462:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6832:x1876350877050112:12345-0@lo:502: Request processed in 286us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427723.983469:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789427723.987164:0:6832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6832:1876350877050112:0@lo:502: 00000100:00100000:0.0:1789427723.987267:0:6832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6832:1876350877050240:0@lo:502: 00000100:00100000:0.0:1789427723.987334:0:6832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427723.987381:0:6832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053ba780 going to sleep for 11 seconds 00000100:00100000:2.0:1789427723.987536:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877050240 00000100:00100000:2.0:1789427723.987544:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877050240 00000100:00100000:2.0:1789427723.987597:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789427723.987606:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6832:x1876350877050240:12345-0@lo:502: 00000100:00100000:2.0:1789427723.987864:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:6832:x1876350877050240:12345-0@lo:502: Request processed in 259us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427723.987873:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789427724.001946:0:6832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6832:1876350877050240:0@lo:502: 00000040:00080000:0.0:1789427724.001997:0:6832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789427724.002141:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789427724.002165:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789427724.002210:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.002236:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427724.002246:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789427724.002249:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933433d9c800 from 4 10000000:01000000:1.0:1789427724.002251:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789427724.002289:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.002296:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.002306:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427724.002324:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050368:0@lo:101: 00000100:00100000:1.0:1789427724.002384:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427724.002441:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421ad96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427724.002843:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877050368 00000100:00100000:0.0:1789427724.002852:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877050368 00000100:00100000:0.0:1789427724.002908:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789427724.002926:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877050368:12345-0@lo:101: 00010000:00010000:0.0:1789427724.002949:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427724.002963:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343193 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427724.002987:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343193 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427724.002998:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343193 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427724.003014:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031000, rc 0) 00000100:00100000:0.0:1789427724.003056:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877050368:12345-0@lo:101: Request processed in 140us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427724.003062:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789427724.003882:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050368:0@lo:101: 00010000:00010000:1.0:1789427724.003901:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.003911:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427724.003979:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050496:0@lo:256: 00000100:00100000:1.0:1789427724.004018:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427724.004051:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421ad96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427724.004069:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877050496 00000100:00100000:1.0:1789427724.004073:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877050496 00000100:00100000:1.0:1789427724.004107:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789427724.004128:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877050496:12345-0@lo:256: 20000000:01000000:1.0:1789427724.004144:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789427724.004162:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789427724.004165:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789427724.004403:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877050496:12345-0@lo:256: Request processed in 276us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427724.004410:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789427724.004452:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050496:0@lo:256: 10000000:01000000:1.0:1789427724.004486:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789427724.004492:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.004500:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427724.004507:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789427724.004509:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789427724.004511:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789427724.004530:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.004536:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.004544:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427724.004564:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050624:0@lo:101: 00000100:00100000:1.0:1789427724.004585:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427724.004597:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421ad96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427724.004607:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877050624 00000100:00100000:1.0:1789427724.004611:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877050624 00000100:00100000:1.0:1789427724.005269:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789427724.005277:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877050624:12345-0@lo:101: 00010000:00010000:1.0:1789427724.005286:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427724.005297:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3431a1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.005313:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3431a1 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.005322:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3431a1 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.005329:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7600, rc 0) 00000100:00100000:1.0:1789427724.005374:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877050624:12345-0@lo:101: Request processed in 98us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427724.005380:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789427724.005418:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050624:0@lo:101: 00010000:00010000:0.0:1789427724.005432:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427724.005440:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427724.005498:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050752:0@lo:501: 00000100:00100000:0.0:1789427724.005525:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427724.005568:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053ba780 going to sleep for 11 seconds 00000100:00100000:1.0:1789427724.005682:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877050752 00000100:00100000:1.0:1789427724.005688:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877050752 00000100:00100000:1.0:1789427724.005719:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789427724.005725:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877050752:12345-0@lo:501: 00000100:00100000:1.0:1789427724.006835:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877050752:12345-0@lo:501: Request processed in 1105us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427724.006852:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789427724.016280:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050752:0@lo:501: 00000100:00100000:1.0:1789427724.016444:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050880:0@lo:503: 00000100:00100000:1.0:1789427724.016519:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427724.016562:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421ad93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427724.018900:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877050880 00000100:00100000:0.0:1789427724.018931:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877050880 00000100:00100000:0.0:1789427724.019011:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789427724.019021:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877050880:12345-0@lo:503: 00000100:00100000:0.0:1789427724.019461:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877050880:12345-0@lo:503: Request processed in 440us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427724.019470:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789427724.019797:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877050880:0@lo:503: 00000100:00100000:1.0:1789427724.027291:0:6834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6834:1876350877051008:0@lo:502: 00000100:00100000:1.0:1789427724.027377:0:6834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427724.027423:0:6834:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421ad90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427724.027899:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877051008 00000100:00100000:0.0:1789427724.027918:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877051008 00000100:00100000:0.0:1789427724.028005:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789427724.028014:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:6834:x1876350877051008:12345-0@lo:502: 00000100:00100000:0.0:1789427724.028367:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:6834:x1876350877051008:12345-0@lo:502: Request processed in 353us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427724.028376:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789427724.028841:0:6834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6834:1876350877051008:0@lo:502: 00000020:01000000:3.0:1789427724.028876:0:6834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789427724.028883:0:6834:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789427724.028890:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427724.028893:0:6834:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789427724.028899:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789427724.028903:0:6834:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.155@tcp to nid 0x20000c0a8c99b (192.168.201.155@tcp) 00000020:01000000:3.0:1789427724.028949:0:6834:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789427724.028952:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789427724.028966:0:6834:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9334101319c0) 00000020:00000080:3.0:1789427724.028987:0:6834:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789427724.028992:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789427724.029076:0:6834:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789427724.029082:0:6834:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789427724.029089:0:6834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca3431b6 00010000:00080000:3.0:1789427724.029117:0:6834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93343fb4f800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.155@tcp at head 00010000:00010000:3.0:1789427724.029362:0:6834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789427724.130024:0:6834:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789427724.130052:0:6834:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789427724.134644:0:6834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427724.135205:0:6834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427724.135259:0:6834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789427724.135322:0:6834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789427724.137235:0:6839:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427724.137242:0:6839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789427724.138619:0:6834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789427724.138642:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789427724.138678:0:6834:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789427724.138699:0:6834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca3431bd 00000100:00080000:3.0:1789427724.138710:0:6834:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789427724.138722:0:6834:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93343fb4f800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:3.0:1789427724.138763:0:6834:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343b901c00 x1876350877051136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789427724.138791:0:6834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789427724.138842:0:6834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427724.138846:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427724.138848:0:6834:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789427724.138851:0:6834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427724.138855:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427724.138857:0:6834:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789427724.138860:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789427724.138862:0:6834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789427724.138889:0:6834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6834:1876350877051264:0@lo:502: 00000100:00100000:3.0:1789427724.138983:0:6834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427724.139024:0:6834:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427724.139229:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877051136:0@lo:8: 00000100:00100000:2.0:1789427724.139267:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427724.139359:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877051264 00000100:00100000:0.0:1789427724.139368:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877051264 00000100:00100000:0.0:1789427724.139419:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789427724.139429:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:6834:x1876350877051264:12345-0@lo:502: 00000100:00100000:1.0:1789427724.140055:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877051136 00000100:00100000:1.0:1789427724.140062:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877051136 00000100:00100000:1.0:1789427724.140087:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427724.140093:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876350877051136:12345-0@lo:8: 00010000:00080000:1.0:1789427724.140117:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1789427724.140143:0:6682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca3431c4 00000100:00100000:0.0:1789427724.140431:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:6834:x1876350877051264:12345-0@lo:502: Request processed in 1003us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427724.140440:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00002000:00100000:1.0:1789427724.140952:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9333013fa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789427724.140959:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1789427724.140963:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789427724.141083:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789427724.141299:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877051392:0@lo:400: 00000100:00100000:0.0:1789427724.141343:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427724.141376:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427724.141383:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877051520:0@lo:400: 00000100:00100000:0.0:1789427724.141404:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427724.141451:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877051392 00000100:00100000:0.0:1789427724.141458:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877051392 00000100:00100000:0.0:1789427724.141489:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877051520 00000100:00100000:0.0:1789427724.141493:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877051520 00000100:00100000:0.0:1789427724.141518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789427724.141526:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877051392:12345-0@lo:400: 00002000:00080000:1.0:1789427724.142317:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789427724.142345:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9333013f8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789427724.142405:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1876350877051136:12345-0@lo:8: Request processed in 2310us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427724.142414:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789427724.142467:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343b901c00 x1876350877051136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789427734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427724.142494:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789427724.142503:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789427724.142511:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789427724.142516:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789427724.142518:0:3297:0:(import.c:65:import_set_state_nolock()) ffff93343fb4f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789427724.142838:0:6834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:6834:1876350877051264:0@lo:502: 00000020:01000000:3.0:1789427724.142879:0:6834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427724.142887:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427724.142889:0:6834:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789427724.142895:0:6834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1789427724.142977:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877051392:12345-0@lo:400: Request processed in 1451us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427724.142984:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789427724.143003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789427724.143012:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877051520:12345-0@lo:400: 00000100:00100000:0.0:1789427724.143040:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877051520:12345-0@lo:400: Request processed in 31us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427724.143051:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789427724.143081:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789427724.143101:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343ae60700 x1876350877051520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427724.143111:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877051520:0@lo:400: 00010000:00080000:0.0:1789427724.143123:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343ae62680 x1876350877051392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427724.143132:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877051392:0@lo:400: 00000020:01000000:0.0:1789427724.143152:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000004:00080000:1.0:1789427724.144035:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789427724.144047:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877051136:0@lo:8: 00000004:00080000:3.0:1789427724.144221:0:6839:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789427724.144329:0:6839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 179079153528ns, next at 0ns, rc = 0 10000000:01000000:0.0:1789427724.144335:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789427724.144347:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427724.144358:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427724.144369:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789427724.144371:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9334101b3380 from 1 10000000:01000000:0.0:1789427724.144374:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789427724.144407:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427724.144415:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427724.144424:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427724.144456:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877051648:0@lo:101: 00000100:00100000:0.0:1789427724.144505:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427724.144712:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877051648 00000100:00100000:3.0:1789427724.144720:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877051648 00000100:00100000:3.0:1789427724.144760:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789427724.144769:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877051648:12345-0@lo:101: 00010000:00010000:3.0:1789427724.144780:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427724.144792:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3431cb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427724.144815:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3431cb expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427724.144826:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3431cb expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427724.144835:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527200, rc 0) 00000100:00100000:3.0:1789427724.144870:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877051648:12345-0@lo:101: Request processed in 102us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427724.144877:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789427724.145455:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b60540 going to sleep for 11 seconds 00000100:00100000:0.0:1789427724.145477:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877051648:0@lo:101: 00010000:00010000:0.0:1789427724.145491:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427724.145501:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427724.146894:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877051776:0@lo:501: 00000100:00100000:0.0:1789427724.146959:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427724.146990:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b60540 going to sleep for 11 seconds 00000100:00100000:0.0:1789427724.147023:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877051776 00000100:00100000:0.0:1789427724.147029:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877051776 00000100:00100000:0.0:1789427724.147069:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789427724.147078:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877051776:12345-0@lo:501: 00000100:00100000:0.0:1789427724.148447:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877051776:12345-0@lo:501: Request processed in 1364us (1481us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789427724.148459:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789427724.148604:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877051776:0@lo:501: 10000000:01000000:1.0:1789427724.148652:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789427724.148967:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427724.148980:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427724.224867:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789427724.224963:0:6840:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789427724.224992:0:6840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406140a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876350877052032:0@lo:7: 00000100:00100000:1.0:1789427724.225058:0:6840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427724.225115:0:6840:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421ad9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427724.225138:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877051904:0@lo:13: 00000100:00100000:1.0:1789427724.225161:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427724.225227:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877052032 00000100:00100000:1.0:1789427724.225235:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877052032 00000100:00100000:1.0:1789427724.225293:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789427724.225303:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6840:x1876350877052032:12345-0@lo:7: 00000100:00100000:0.0:1789427724.230250:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877051904 00000100:00100000:0.0:1789427724.230265:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877051904 00000100:00100000:0.0:1789427724.230320:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789427724.230329:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1876350877051904:12345-0@lo:13: 00002000:00000024:0.0:1789427724.230364:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789427724.230461:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1876350877051904:12345-0@lo:13: Request processed in 132us (5298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427724.230479:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789427724.231366:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933406143b80 x1876350877051904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427724.231388:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877051904:0@lo:13: 00000100:00080000:1.0:1789427724.231416:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1789427724.234903:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789427724.234912:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789427724.235014:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6840:x1876350877052032:12345-0@lo:7: Request processed in 9708us (9951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427724.235025:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789427724.235161:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933406140a80 x1876350877052032/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789427740 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427724.235214:0:6840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406140a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876350877052032:0@lo:7: 00000004:00080000:2.0:1789427724.235229:0:6840:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789427724.235270:0:6840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876350877052160:0@lo:5: 00000100:00100000:2.0:1789427724.235308:0:6840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427724.235411:0:6840:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b480c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427724.235594:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877052160 00000100:00100000:1.0:1789427724.235601:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877052160 00000100:00100000:1.0:1789427724.235711:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427724.235722:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6840:x1876350877052160:12345-0@lo:5: 00002000:00080000:1.0:1789427724.235746:0:6682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789427724.235750:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789427724.236233:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6840:x1876350877052160:12345-0@lo:5: Request processed in 513us (924us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789427724.236242:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789427724.236311:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933420ed3800 x1876350877052160/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427740 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427724.236325:0:6840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876350877052160:0@lo:5: 00000004:00080000:2.0:1789427724.236334:0:6840:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789427724.236362:0:6840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876350877052288:0@lo:700: 00000100:00100000:2.0:1789427724.236390:0:6840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427724.236415:0:6840:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b480c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427724.236575:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877052288 00000100:00100000:1.0:1789427724.236580:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877052288 00000100:00100000:1.0:1789427724.236613:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427724.236684:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6840:x1876350877052288:12345-0@lo:700: 00000100:00100000:1.0:1789427724.236717:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1876350877052416:0@lo:700: 00000100:00100000:1.0:1789427724.236748:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427724.236778:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421ad9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789427724.236842:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877052416 00000100:00100000:3.0:1789427724.236847:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877052416 00000100:00100000:3.0:1789427724.236882:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427724.236891:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1876350877052416:12345-0@lo:700: 40000000:02000000:3.0:1789427724.285062:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789427724.298487:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1876350877052416:12345-0@lo:700: Request processed in 61589us (61729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427724.298502:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789427724.299446:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933406143b80 x1876350877052416/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789427740 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427724.299463:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1876350877052416:0@lo:700: 40000000:02000000:2.0:1789427724.299477:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1789427724.466296:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789427724.466324:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789427724.466645:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6840:x1876350877052288:12345-0@lo:700: Request processed in 230018us (230247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427724.466668:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789427724.466780:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933420ed2680 x1876350877052288/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789427740 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427724.466806:0:6840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789427724.466827:0:6840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876350877052288:0@lo:700: 00010000:00010000:0.0:1789427724.496933:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:3.0:1789427724.547404:0:6840:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789427724.559257:0:6840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876350877052544:0@lo:5: 00000100:00100000:3.0:1789427724.559325:0:6840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427724.559380:0:6840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340f140900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427724.560533:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877052544 00000100:00100000:2.0:1789427724.560545:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877052544 00000100:00100000:2.0:1789427724.560602:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789427724.560613:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6840:x1876350877052544:12345-0@lo:5: 00002000:00080000:2.0:1789427724.580068:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789427724.580086:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789427724.594565:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b902680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6840:x1876350877052544:12345-0@lo:5: Request processed in 33945us (35231us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789427724.594596:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789427724.594622:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343b900000 x1876350877052544/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427740 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427724.594651:0:6840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1876350877052544:0@lo:5: 00000004:00080000:1.0:1789427724.594667:0:6840:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1789427725.513316:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427726.539600:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427727.563082:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427728.589446:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427729.353812:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877052672:0@lo:400: 00000100:00100000:3.0:1789427729.353893:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427729.353945:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427729.353951:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877053056:0@lo:400: 00000100:00100000:3.0:1789427729.353976:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427729.354012:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877052672 00000100:00100000:3.0:1789427729.354020:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877052672 00000100:00100000:3.0:1789427729.354059:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789427729.354068:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3299:x1876350877052672:12345-0@lo:400: 00000100:00100000:3.0:1789427729.354111:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3299:x1876350877052672:12345-0@lo:400: Request processed in 45us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427729.354119:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789427729.354148:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877053056 00000100:00100000:3.0:1789427729.354152:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877053056 00000100:00100000:3.0:1789427729.354204:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427729.354212:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877053056:12345-0@lo:400: 00000100:00100000:3.0:1789427729.354255:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877053056:12345-0@lo:400: Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427729.354261:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789427729.354276:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789427729.354305:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343b902d80 x1876350877053056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427729.354320:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877053056:0@lo:400: 00000100:00100000:3.0:1789427729.354329:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877052672:0@lo:400: 00000100:00100000:1.0:1789427729.364298:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877053184:0@lo:13: 00000100:00100000:1.0:1789427729.364368:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427729.378528:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877052928:0@lo:400: 00000100:00100000:2.0:1789427729.378600:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427729.378640:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427729.378647:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877052800:0@lo:400: 00000100:00100000:2.0:1789427729.378666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427729.382365:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877053184 00000100:00100000:0.0:1789427729.382385:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877053184 00000100:00100000:0.0:1789427729.382461:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427729.382473:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877053184:12345-0@lo:13: 00002000:00000024:0.0:1789427729.382515:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427729.382607:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877053184:12345-0@lo:13: Request processed in 136us (18238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427729.382614:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427729.382640:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877052928 00000100:00100000:0.0:1789427729.382644:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877052928 00000100:00100000:0.0:1789427729.382694:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877052800 00000100:00100000:0.0:1789427729.382698:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877052800 00000100:00100000:0.0:1789427729.382710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789427729.382716:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877052928:12345-0@lo:400: 00000100:00100000:0.0:1789427729.382756:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877052928:12345-0@lo:400: Request processed in 40us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427729.382762:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789427729.382774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427729.382779:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877052800:12345-0@lo:400: 00000100:00100000:0.0:1789427729.382804:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877052800:12345-0@lo:400: Request processed in 26us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427729.382809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789427729.382898:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933406141c00 x1876350877053184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427729.382920:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877053184:0@lo:13: 00000100:00080000:0.0:1789427729.382956:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789427729.383000:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343b902300 x1876350877052800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427729.383012:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877052800:0@lo:400: 00010000:00080000:0.0:1789427729.383024:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343b901f80 x1876350877052928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427729.383032:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877052928:0@lo:400: 00000001:00080000:0.0:1789427729.509008:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:1.0:1789427729.543883:0:7054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789427729.616250:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427730.638205:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427731.657391:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427732.684444:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427733.706594:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427734.474325:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877053312:0@lo:400: 00000100:00100000:1.0:1789427734.474394:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427734.474437:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877053824:0@lo:400: 00000100:00100000:1.0:1789427734.474474:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427734.477703:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877053440:0@lo:13: 00000100:00100000:3.0:1789427734.477817:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427734.477894:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877053440 00000100:00100000:3.0:1789427734.477903:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877053440 00000100:00100000:3.0:1789427734.477978:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789427734.477988:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877053440:12345-0@lo:13: 00002000:00000024:3.0:1789427734.478030:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427734.478138:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877053440:12345-0@lo:13: Request processed in 152us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427734.478146:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789427734.478167:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789427734.479171:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343b900380 x1876350877053440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427734.479208:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789427734.479235:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877053440:0@lo:13: 00000100:00100000:1.0:1789427734.482851:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877053568:0@lo:400: 00000100:00100000:1.0:1789427734.482935:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427734.482984:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427734.482992:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877053696:0@lo:400: 00000100:00100000:1.0:1789427734.483015:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427734.483061:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877053312 00000100:00100000:1.0:1789427734.483069:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877053312 00000100:00100000:2.0:1789427734.483081:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877053568 00000100:00100000:2.0:1789427734.483085:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877053568 00000100:00100000:2.0:1789427734.483112:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877053696 00000100:00100000:2.0:1789427734.483115:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877053696 00000100:00100000:1.0:1789427734.483115:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789427734.483123:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3300:x1876350877053312:12345-0@lo:400: 00000100:00100000:2.0:1789427734.483136:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789427734.483141:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877053568:12345-0@lo:400: 00000100:00100000:1.0:1789427734.483193:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3300:x1876350877053312:12345-0@lo:400: Request processed in 51us (8780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427734.483198:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877053568:12345-0@lo:400: Request processed in 33us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427734.483200:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789427734.483204:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789427734.483219:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789427734.483225:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877053696:12345-0@lo:400: 00000100:00100000:1.0:1789427734.483241:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877053824 00000100:00100000:1.0:1789427734.483244:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877053824 00000100:00100000:2.0:1789427734.483264:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877053696:12345-0@lo:400: Request processed in 39us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427734.483272:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427734.483279:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789427734.483279:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877053824:12345-0@lo:400: 00000100:00080000:2.0:1789427734.483297:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427734.483310:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877053824:12345-0@lo:400: Request processed in 32us (8835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427734.483316:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789427734.483354:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877053312:0@lo:400: 00010000:00080000:1.0:1789427734.483367:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933406141f80 x1876350877053824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427734.483379:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877053824:0@lo:400: 00010000:00080000:1.0:1789427734.483405:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933406142300 x1876350877053696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427734.483414:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877053696:0@lo:400: 00010000:00080000:1.0:1789427734.483424:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933406140380 x1876350877053568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427734.483431:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877053568:0@lo:400: 00010000:00010000:3.0:1789427734.729390:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427735.758040:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427736.779234:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427737.801649:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427738.825546:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427739.593898:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877054080:0@lo:400: 00000100:00100000:3.0:1789427739.593911:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877054464:0@lo:400: 00000100:00100000:0.0:1789427739.593911:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877054208:0@lo:400: 00000100:00100000:1.0:1789427739.594023:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877054336:0@lo:400: 00000100:00100000:3.0:1789427739.594205:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427739.594276:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877054464 00000100:00100000:3.0:1789427739.594284:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877054464 00000100:00100000:3.0:1789427739.594338:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789427739.594348:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877054464:12345-0@lo:400: 00000100:00100000:3.0:1789427739.594604:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877054464:12345-0@lo:400: Request processed in 256us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427739.594612:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789427739.594646:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789427739.594687:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343ae62a00 x1876350877054464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427739.594702:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877054464:0@lo:400: 00000100:00100000:2.0:1789427739.594868:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427739.594906:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427739.594913:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877053952:0@lo:13: 00000100:00100000:2.0:1789427739.594948:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427739.594949:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877054208 00000100:00100000:0.0:1789427739.594955:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877054208 00000100:00100000:3.0:1789427739.594967:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877054080 00000100:00100000:3.0:1789427739.594972:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877054080 00000100:00100000:0.0:1789427739.594991:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789427739.594998:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877054208:12345-0@lo:400: 00000100:00100000:3.0:1789427739.595001:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789427739.595007:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3301:x1876350877054080:12345-0@lo:400: 00000100:00100000:2.0:1789427739.595011:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877053952 00000100:00100000:2.0:1789427739.595017:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877053952 00000100:00100000:3.0:1789427739.595042:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3301:x1876350877054080:12345-0@lo:400: Request processed in 34us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427739.595042:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877054208:12345-0@lo:400: Request processed in 43us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427739.595050:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789427739.595050:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789427739.595057:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789427739.595067:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877053952:12345-0@lo:13: 00000100:00100000:3.0:1789427739.595091:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877054080:0@lo:400: 00010000:00080000:0.0:1789427739.595093:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343ae61180 x1876350877054208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427739.595102:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877054208:0@lo:400: 00002000:00000024:2.0:1789427739.595104:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427739.595210:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427739.595431:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877053952:12345-0@lo:13: Request processed in 365us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427739.595438:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789427739.595514:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343b903800 x1876350877053952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427739.595529:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877053952:0@lo:13: 00000100:00100000:0.0:1789427739.595857:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877054336 00000100:00100000:0.0:1789427739.595863:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877054336 00000100:00100000:0.0:1789427739.595916:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789427739.595924:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877054336:12345-0@lo:400: 00000100:00100000:0.0:1789427739.595973:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877054336:12345-0@lo:400: Request processed in 50us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427739.595993:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789427739.596017:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789427739.596159:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343ae60a80 x1876350877054336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427739.596169:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877054336:0@lo:400: 00010000:00010000:2.0:1789427739.849896:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427740.883202:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789427741.297459:0:7619:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789427741.297463:0:7619:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789427741.297615:0:7619:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93341d0db000 00000020:01000004:2.0:1789427741.297637:0:7619:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789427741.297649:0:7619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789427741.297674:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff933420f34d40) 00000020:00000080:2.0:1789427741.297695:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789427741.345909:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789427741.346723:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789427741.382754:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789427741.388533:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789427741.388570:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789427741.392605:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789427741.392694:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789427741.393536:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789427741.393549:0:7619:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789427741.393561:0:7619:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bea1a57ca3431e0 00000020:01000004:3.0:1789427741.393569:0:7619:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789427741.393589:0:7619:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.155@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789427741.393593:0:7619:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789427741.393601:0:7619:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789427741.393639:0:7619:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789427741.393643:0:7619:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789427741.450789:0:7619:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789427741.450820:0:7619:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.155@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789427741.450826:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789427741.450827:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789427741.450828:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427741.450828:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427741.450829:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427741.450830:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427741.450831:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427741.450832:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427741.450833:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427741.450834:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427741.450835:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789427741.450838:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789427741.450839:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789427741.450840:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789427741.450840:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427741.450841:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427741.450842:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427741.450842:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427741.450843:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427741.450844:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427741.450844:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427741.450845:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427741.450845:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789427741.450876:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789427741.450892:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877054592:0@lo:253: 00000100:00100000:1.0:1789427741.450953:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.451044:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421c0aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427741.455305:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877054592 00000100:00100000:3.0:1789427741.455322:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877054592 00000100:00100000:3.0:1789427741.455395:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789427741.455406:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:7619:x1876350877054592:12345-0@lo:253: 20000000:01000000:3.0:1789427741.455444:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789427741.455449:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789427741.455454:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789427741.455458:0:5829:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789427741.457677:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427741.457887:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789427741.457902:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789427741.457936:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789427741.457944:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789427741.457967:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789427741.458024:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789427741.458843:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789427741.458865:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.155@tcp 20000000:01000000:2.0:1789427741.458867:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.155@tcp (null) (null) (null) 00000040:00080000:2.0:1789427741.458903:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789427741.458910:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789427741.458949:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789427741.458955:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.155@tcp (null) (null) 00000040:00080000:2.0:1789427741.458980:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789427741.458988:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789427741.459011:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789427741.459048:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789427741.459933:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789427741.459952:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.155@tcp 20000000:01000000:2.0:1789427741.459954:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.155@tcp (null) (null) (null) 00000040:00080000:2.0:1789427741.459999:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789427741.460007:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789427741.460035:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789427741.460042:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.155@tcp (null) (null) 00000040:00080000:2.0:1789427741.460069:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789427741.460077:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789427741.460252:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789427741.460296:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789427741.460312:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789427741.460315:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789427741.460319:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789427741.460331:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789427741.460333:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789427741.460367:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789427741.460369:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789427741.460817:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789427741.461035:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789427741.461070:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789427741.461137:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789427741.461150:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789427741.461152:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789427741.461811:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789427741.461867:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789427741.461920:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789427741.462160:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789427741.462243:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789427741.462299:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789427741.462314:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789427741.462316:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789427741.463333:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789427741.463413:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789427741.463467:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789427741.463964:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789427741.463990:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789427741.464007:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789427741.464014:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789427741.464016:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789427741.465411:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789427741.465563:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789427741.465603:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789427741.466003:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789427741.466051:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789427741.466107:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1789427741.466606:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789427741.466609:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789427741.466630:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789427741.466727:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.466746:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343131 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.466755:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34315b expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.466762:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343185 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.466769:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3431a1 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.466775:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3431cb expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.466782:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.466826:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3431cb expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.466841:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3431cb expref: 16 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427741.466855:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877054720:0@lo:104: 00000100:00100000:0.0:1789427741.466933:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427741.467025:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3431a1 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.467033:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3431a1 expref: 16 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427741.467042:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877054848:0@lo:104: 00010000:00010000:0.0:1789427741.467069:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343185 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.467078:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343185 expref: 16 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427741.467086:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae63100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877054976:0@lo:104: 00010000:00010000:0.0:1789427741.467109:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34315b expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.467117:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34315b expref: 16 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427741.467139:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae63800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877055104:0@lo:104: 00010000:00010000:0.0:1789427741.467208:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343131 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.467216:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343131 expref: 16 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427741.467225:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877055232:0@lo:104: 00000100:00100000:0.0:1789427741.467254:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340822fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427741.467538:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789427741.467561:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.467615:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.467732:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427741.467756:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877054720 00000100:00100000:0.0:1789427741.467764:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877054720 00000100:00100000:0.0:1789427741.467800:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877054848 00000100:00100000:0.0:1789427741.467803:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877054848 00000100:00100000:0.0:1789427741.467813:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877054976 00000100:00100000:0.0:1789427741.467816:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877054976 00000100:00100000:0.0:1789427741.467829:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427741.467838:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+5:5829:x1876350877054720:12345-0@lo:104: 00010000:00010000:0.0:1789427741.467851:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.467918:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427741.467924:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+5:5829:x1876350877054720:12345-0@lo:104: Request processed in 88us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427741.467932:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427741.467974:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789427741.467980:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b903800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:5829:x1876350877054848:12345-0@lo:104: 00010000:00010000:0.0:1789427741.467987:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.468019:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789427741.468024:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b903800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:5829:x1876350877054848:12345-0@lo:104: Request processed in 45us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427741.468030:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789427741.468046:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789427741.468051:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b900380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5829:x1876350877054976:12345-0@lo:104: 00010000:00010000:0.0:1789427741.468059:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.468093:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789427741.468098:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b900380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5829:x1876350877054976:12345-0@lo:104: Request processed in 47us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427741.468104:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789427741.468239:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877054720:0@lo:104: 00000100:00100000:2.0:1789427741.468249:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877054848:0@lo:104: 00000100:00100000:2.0:1789427741.468255:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae63100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877054976:0@lo:104: 00010000:00010000:1.0:1789427741.468310:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789427741.468317:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.468325:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031e00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427741.468329:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.468338:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427741.468345:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427741.468351:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427741.468393:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.468399:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427741.468421:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.468429:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3431cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3431d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.468442:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789427741.468452:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.468458:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c7000 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427741.468461:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.468468:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427741.468474:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427741.468480:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427741.468509:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.468515:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789427741.468908:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.468921:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877055104 00000100:00100000:3.0:1789427741.468926:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877055104 00000100:00100000:3.0:1789427741.468951:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877055232 00000100:00100000:3.0:1789427741.468954:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877055232 00000100:00100000:3.0:1789427741.468967:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789427741.468974:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b900000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:5829:x1876350877055104:12345-0@lo:104: 00010000:00010000:3.0:1789427741.468983:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.469021:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789427741.469026:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b900000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:5829:x1876350877055104:12345-0@lo:104: Request processed in 53us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.469032:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789427741.469045:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789427741.469050:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5829:x1876350877055232:12345-0@lo:104: 00010000:00010000:3.0:1789427741.469056:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.469078:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789427741.469082:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5829:x1876350877055232:12345-0@lo:104: Request processed in 33us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.469098:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789427741.469133:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877055360:0@lo:103: 00000100:00100000:3.0:1789427741.469164:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.469232:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877055360 00000100:00100000:3.0:1789427741.469236:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877055360 00010000:00010000:3.0:1789427741.469254:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3431cb expref: 17 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427741.469276:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789427741.469282:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b902300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:3301:x1876350877055360:12345-0@lo:103: 00010000:00010000:3.0:1789427741.469293:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427741.469298:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3431cb expref: 17 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.469308:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3431cb expref: 17 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.469321:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401527200/0x2bea1a57ca3431d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3431cb expref: 17 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.469333:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427741.469359:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b902300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3301:x1876350877055360:12345-0@lo:103: Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.469365:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789427741.469392:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877055360:0@lo:103: 00000100:00100000:2.0:1789427741.469614:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae63800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877055104:0@lo:104: 00000100:00100000:2.0:1789427741.469633:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1876350877055232:0@lo:104: 00010000:00010000:2.0:1789427741.469664:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427741.469752:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789427741.469772:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.469780:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3431a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.469790:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789427741.469794:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.469799:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02ae00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427741.469803:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.469825:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427741.469831:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427741.469836:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427741.469869:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.469874:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427741.469960:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789427741.469976:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427741.469986:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877055616:0@lo:103: 00000100:00100000:0.0:1789427741.470016:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427741.470049:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877055616 00000100:00100000:0.0:1789427741.470054:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877055616 00010000:00010000:0.0:1789427741.470071:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343185 expref: 16 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427741.470092:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789427741.470099:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3298:x1876350877055616:12345-0@lo:103: 00010000:00010000:0.0:1789427741.470107:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427741.470111:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343185 expref: 16 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.470130:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343185 expref: 16 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.470141:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c6c00/0x2bea1a57ca34318c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343185 expref: 16 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.470152:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427741.470197:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:3298:x1876350877055616:12345-0@lo:103: Request processed in 99us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427741.470215:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789427741.470245:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877055616:0@lo:103: 00010000:00010000:0.0:1789427741.470405:0:7625:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427741.470412:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.470419:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427741.470422:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.470430:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427741.470437:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427741.470442:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427741.470462:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.470468:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427741.470477:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.470483:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca34315b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343162 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.470506:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427741.470508:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427741.470515:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427741.470772:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877055744:0@lo:103: 00000100:00100000:3.0:1789427741.470803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427741.470908:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877055744 00000100:00100000:0.0:1789427741.470914:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877055744 00010000:00010000:0.0:1789427741.470931:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34315b expref: 15 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427741.470991:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789427741.470998:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:3300:x1876350877055744:12345-0@lo:103: 00010000:00010000:0.0:1789427741.471007:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427741.471011:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34315b expref: 15 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.471020:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34315b expref: 15 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.471031:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34315b expref: 15 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.471041:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427741.471070:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3300:x1876350877055744:12345-0@lo:103: Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427741.471076:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789427741.471187:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877055488:0@lo:103: 00000100:00100000:2.0:1789427741.471216:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427741.471437:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.471446:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02ae00/0x2bea1a57ca343185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34318c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.471456:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427741.471457:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427741.471459:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427741.471702:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877055488 00000100:00100000:3.0:1789427741.471707:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877055488 00010000:00010000:3.0:1789427741.471727:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3431a1 expref: 14 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427741.471743:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789427741.471749:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3299:x1876350877055488:12345-0@lo:103: 00010000:00010000:3.0:1789427741.471757:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427741.471761:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3431a1 expref: 14 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.471770:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3431a1 expref: 14 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.471780:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7600/0x2bea1a57ca3431a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3431a1 expref: 14 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.471789:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427741.471825:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:3299:x1876350877055488:12345-0@lo:103: Request processed in 76us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.471832:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789427741.471910:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877055488:0@lo:103: 00010000:00010000:2.0:1789427741.472017:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427741.472020:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427741.472022:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427741.472047:0:7625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.472054:0:7625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401526800 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427741.472058:0:7625:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.472066:0:7625:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427741.472080:0:7625:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427741.472085:0:7625:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427741.472115:0:7625:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.472128:0:7625:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427741.472140:0:7625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.472147:0:7625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401526800/0x2bea1a57ca343131 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.472159:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427741.472161:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427741.472162:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427741.472649:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877055872:0@lo:103: 00000100:00100000:3.0:1789427741.472685:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.472772:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877055744:0@lo:103: 00000100:00100000:0.0:1789427741.472814:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877055872 00000100:00100000:0.0:1789427741.472819:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877055872 00010000:00010000:0.0:1789427741.472837:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343131 expref: 13 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427741.472878:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789427741.472887:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b900700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:3301:x1876350877055872:12345-0@lo:103: 00010000:00010000:2.0:1789427741.472896:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427741.472900:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343131 expref: 13 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472909:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343131 expref: 13 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472927:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401526000/0x2bea1a57ca343138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343131 expref: 13 pid: 5829 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472940:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472948:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472963:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472970:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472976:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472982:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472988:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789427741.472992:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.472999:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.473021:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.473042:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427741.473084:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b900700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:3301:x1876350877055872:12345-0@lo:103: Request processed in 198us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427741.473091:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789427741.473333:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.473342:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.473359:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400031800/0x2bea1a57ca3431e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789427741.473372:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789427741.475882:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877055872:0@lo:103: 00000100:00100000:2.0:1789427741.505562:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:7619:x1876350877054592:12345-0@lo:253: Request processed in 50147us (54596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427741.505577:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789427741.505675:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877054592:0@lo:253: 10000000:01000000:1.0:1789427741.505693:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789427741.505696:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789427741.505698:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789427741.505700:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427741.505701:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789427741.505702:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427741.505703:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427741.505719:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427741.505721:0:7619:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789427741.505723:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427741.505724:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789427741.505742:0:7619:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93341d0db000 from lustre-OST0001 10000000:01000000:1.0:1789427741.505764:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789427741.505766:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789427741.505773:0:7619:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9334101b3380 local copy 10000000:01000000:1.0:1789427741.505776:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789427741.505807:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.505815:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.505822:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427741.505836:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056000:0@lo:101: 00000100:00100000:1.0:1789427741.505862:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.505918:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b7bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427741.505951:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877056000 00000100:00100000:3.0:1789427741.505957:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877056000 00000100:00100000:3.0:1789427741.506021:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789427741.506031:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+11:7619:x1876350877056000:12345-0@lo:101: 00010000:00010000:3.0:1789427741.506045:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427741.506057:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401527200/0x2bea1a57ca3431f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3431ee expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.506080:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401527200/0x2bea1a57ca3431f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3431ee expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.506090:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401527200/0x2bea1a57ca3431f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3431ee expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.506098:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527200, rc 0) 00000100:00100000:3.0:1789427741.506144:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:7619:x1876350877056000:12345-0@lo:101: Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.506149:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789427741.506209:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056000:0@lo:101: 00010000:00010000:1.0:1789427741.506221:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.506230:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427741.506311:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056128:0@lo:501: 00000100:00100000:1.0:1789427741.506331:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.506539:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b7bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427741.506591:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877056128 00000100:00100000:2.0:1789427741.506597:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877056128 00000100:00100000:0.0:1789427741.506639:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789427741.506648:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:7619:x1876350877056128:12345-0@lo:501: 00000100:00100000:0.0:1789427741.506861:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:7619:x1876350877056128:12345-0@lo:501: Request processed in 215us (528us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789427741.506868:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789427741.506942:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056128:0@lo:501: 10000000:01000000:1.0:1789427741.506954:0:7619:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789427741.506977:0:7619:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789427741.506981:0:7619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.506987:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.506992:0:7619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.507010:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789427741.507027:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93341d0db000 10000000:01000000:1.0:1789427741.507031:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789427741.507035:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789427741.507036:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789427741.507039:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789427741.507041:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789427741.507054:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.507059:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.507064:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427741.507072:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056256:0@lo:101: 00000100:00100000:1.0:1789427741.507090:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.507108:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b7b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789427741.507127:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877056256 00000100:00100000:1.0:1789427741.507130:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877056256 00000100:00100000:1.0:1789427741.507143:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789427741.507147:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:7619:x1876350877056256:12345-0@lo:101: 00010000:00010000:1.0:1789427741.507153:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427741.507160:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3431fc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.507171:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3431fc expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.507191:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3431fc expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.507198:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7200, rc 0) 00000100:00100000:1.0:1789427741.507225:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877056256:12345-0@lo:101: Request processed in 76us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.507231:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789427741.507260:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056256:0@lo:101: 00010000:00010000:1.0:1789427741.507272:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.507280:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427741.507329:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056384:0@lo:501: 00000100:00100000:1.0:1789427741.507353:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.507366:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b7b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789427741.507383:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877056384 00000100:00100000:1.0:1789427741.507387:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877056384 00000100:00100000:1.0:1789427741.507401:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789427741.507404:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877056384:12345-0@lo:501: 00000100:00100000:1.0:1789427741.507534:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877056384:12345-0@lo:501: Request processed in 127us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.507541:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789427741.507571:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056384:0@lo:501: 00000100:00100000:1.0:1789427741.507595:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056512:0@lo:503: 00000100:00100000:1.0:1789427741.507642:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.507654:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b7b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789427741.507666:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877056512 00000100:00100000:1.0:1789427741.507670:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877056512 00000100:00100000:1.0:1789427741.507687:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789427741.507693:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877056512:12345-0@lo:503: 00000100:00100000:1.0:1789427741.507799:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877056512:12345-0@lo:503: Request processed in 105us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.507808:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789427741.507844:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056512:0@lo:503: 00000040:00080000:1.0:1789427741.508071:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789427741.508133:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056640:0@lo:502: 00000100:00100000:1.0:1789427741.508165:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.508198:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c307780 going to sleep for 11 seconds 00000100:00100000:1.0:1789427741.508211:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877056640 00000100:00100000:1.0:1789427741.508215:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877056640 00000100:00100000:1.0:1789427741.508231:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789427741.508237:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877056640:12345-0@lo:502: 00000100:00100000:1.0:1789427741.508372:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877056640:12345-0@lo:502: Request processed in 135us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.508379:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789427741.508420:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056640:0@lo:502: 00000040:00080000:1.0:1789427741.508677:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789427741.508723:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789427741.508767:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789427741.508820:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789427741.508860:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789427741.508900:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789427741.508931:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056768:0@lo:502: 00000100:00100000:1.0:1789427741.508972:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.508990:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c307780 going to sleep for 11 seconds 00000100:00100000:1.0:1789427741.509007:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877056768 00000100:00100000:1.0:1789427741.509012:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877056768 00000100:00100000:1.0:1789427741.509034:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789427741.509040:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877056768:12345-0@lo:502: 00000100:00100000:1.0:1789427741.509162:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877056768:12345-0@lo:502: Request processed in 122us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.509168:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789427741.509226:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877056768:0@lo:502: 00000040:00080000:1.0:1789427741.509295:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789427741.509303:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:0.0:1789427741.509707:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427741.509716:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.509733:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c7000 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427741.509736:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.509745:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427741.509752:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427741.509756:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427741.509780:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.509786:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427741.509814:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.509820:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff9334421c7000/0x2bea1a57ca3431ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bea1a57ca3431f5 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.509832:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427741.509833:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427741.509835:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427741.510000:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427741.510014:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877056896:0@lo:103: 00000100:00100000:3.0:1789427741.510053:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427741.510140:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877056896 00000100:00100000:0.0:1789427741.510146:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877056896 00000100:00100000:0.0:1789427741.510209:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427741.510217:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b900e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:3299:x1876350877056896:12345-0@lo:103: 00010000:00010000:0.0:1789427741.510228:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427741.510246:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401527200/0x2bea1a57ca3431f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca3431ee expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.510259:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427741.510293:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b900e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:3299:x1876350877056896:12345-0@lo:103: Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427741.510300:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427741.510346:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877056896:0@lo:103: 00000020:01000000:0.0:1789427741.510753:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789427741.510760:0:7628:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789427741.510766:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427741.510769:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789427741.510774:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789427741.510789:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93341da2cd40) 00000020:00000080:0.0:1789427741.510815:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789427741.510821:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789427741.510891:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93341d0db000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789427741.510899:0:7628:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789427741.510916:0:7628:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bea1a57ca343211 00010000:00010000:0.0:1789427741.516733:0:7628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789427741.517222:0:7628:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789427741.521809:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789427741.522116:0:7628:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789427741.526107:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789427741.527731:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789427741.529382:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789427741.529394:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427741.529418:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427741.529421:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789427741.529426:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427741.529431:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427741.529432:0:7628:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789427741.529435:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789427741.529437:0:7628:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789427741.529488:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427741.529491:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427741.529493:0:7628:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789427741.529496:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789427741.529763:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789427741.529790:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789427741.529818:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.529838:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427741.529847:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93341d0db000 from 1 10000000:01000000:3.0:1789427741.529849:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789427741.529888:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.529897:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.529908:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427741.529935:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057024:0@lo:101: 00000100:00100000:3.0:1789427741.530010:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.530055:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b670c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427741.531074:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877057024 00000100:00100000:1.0:1789427741.531084:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877057024 00000100:00100000:1.0:1789427741.531303:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789427741.531315:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:7619:x1876350877057024:12345-0@lo:101: 00010000:00010000:1.0:1789427741.531331:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427741.531349:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343218 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.531376:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343218 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.531388:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343218 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.531398:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7000, rc 0) 00000100:00100000:1.0:1789427741.531537:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057024:12345-0@lo:101: Request processed in 225us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.531545:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789427741.531643:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057024:0@lo:101: 00010000:00010000:0.0:1789427741.531661:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.531670:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427741.531794:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057152:0@lo:501: 00000100:00100000:0.0:1789427741.531828:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427741.531865:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340822f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789427741.531934:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877057152 00000100:00100000:3.0:1789427741.531939:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877057152 00000100:00100000:3.0:1789427741.531975:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789427741.531983:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057152:12345-0@lo:501: 00000100:00100000:3.0:1789427741.532348:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057152:12345-0@lo:501: Request processed in 365us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.532355:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789427741.532471:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057152:0@lo:501: 00000100:00100000:0.0:1789427741.532500:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057280:0@lo:503: 00000100:00100000:0.0:1789427741.532539:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427741.532556:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340822f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789427741.532670:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877057280 00000100:00100000:3.0:1789427741.532675:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877057280 00000100:00100000:3.0:1789427741.532704:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789427741.532711:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057280:12345-0@lo:503: 00000100:00100000:3.0:1789427741.533006:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057280:12345-0@lo:503: Request processed in 295us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.533013:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789427741.533358:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057280:0@lo:503: 00000040:00080000:0.0:1789427741.533725:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789427741.533799:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057408:0@lo:502: 00000100:00100000:0.0:1789427741.533843:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427741.533923:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340822f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789427741.539055:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877057408 00000100:00100000:3.0:1789427741.539074:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877057408 00000100:00100000:3.0:1789427741.539145:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789427741.539157:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057408:12345-0@lo:502: 00000100:00100000:3.0:1789427741.539928:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057408:12345-0@lo:502: Request processed in 770us (6081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.539938:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789427741.546513:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057408:0@lo:502: 00000040:00080000:1.0:1789427741.546860:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789427741.546930:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789427741.546970:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057536:0@lo:502: 00000100:00100000:1.0:1789427741.547038:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.547088:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341107c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789427741.547393:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877057536 00000100:00100000:2.0:1789427741.547402:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877057536 00000100:00100000:3.0:1789427741.547649:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789427741.547661:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057536:12345-0@lo:502: 00000100:00100000:3.0:1789427741.548325:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057536:12345-0@lo:502: Request processed in 665us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.548334:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789427741.548717:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057536:0@lo:502: 00000040:00080000:1.0:1789427741.548849:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789427741.548861:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789427741.551616:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427741.551639:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427741.551642:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789427741.551650:0:7632:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93341d0db000 00000020:00000080:1.0:1789427741.551652:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789427741.551673:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427741.551676:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427741.551677:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789427741.551680:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789427741.551825:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789427741.551851:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427741.551875:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.551888:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427741.551935:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789427741.551938:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93341d0db000 10000000:01000000:2.0:1789427741.551941:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93341d0db000 10000000:01000000:2.0:1789427741.551945:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789427741.551951:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93341d0db000 from 1 10000000:01000000:2.0:1789427741.551953:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789427741.551993:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.552002:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.552024:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427741.552049:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057664:0@lo:101: 00000100:00100000:2.0:1789427741.552326:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427741.552375:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427741.552616:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877057664 00000100:00100000:0.0:1789427741.552634:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877057664 00000100:00100000:0.0:1789427741.552687:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789427741.552697:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877057664:12345-0@lo:101: 00010000:00010000:0.0:1789427741.552710:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427741.552723:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343226 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.552746:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343226 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.552755:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343226 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427741.552777:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030e00, rc 0) 00000100:00100000:0.0:1789427741.552819:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877057664:12345-0@lo:101: Request processed in 123us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427741.552825:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789427741.552901:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057664:0@lo:101: 00010000:00010000:2.0:1789427741.552915:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.552923:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427741.553020:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057792:0@lo:501: 00000100:00100000:2.0:1789427741.553048:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427741.553066:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427741.554784:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877057792 00000100:00100000:3.0:1789427741.554799:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877057792 00000100:00100000:3.0:1789427741.554852:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789427741.554863:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877057792:12345-0@lo:501: 00000100:00100000:2.0:1789427741.555604:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057792:0@lo:501: 00000100:00100000:2.0:1789427741.555665:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057920:0@lo:503: 00000100:00100000:2.0:1789427741.555714:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.555774:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877057792:12345-0@lo:501: Request processed in 912us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.555782:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789427741.555828:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427741.559588:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877057920 00000100:00100000:3.0:1789427741.559605:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877057920 00000100:00100000:1.0:1789427741.560315:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789427741.560330:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877057920:12345-0@lo:503: 00000100:00100000:1.0:1789427741.560600:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877057920:12345-0@lo:503: Request processed in 274us (4885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.560608:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789427741.560798:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877057920:0@lo:503: 00000040:00080000:2.0:1789427741.561103:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789427741.561229:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877058048:0@lo:502: 00000100:00100000:2.0:1789427741.561276:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427741.561310:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427741.563348:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877058048 00000100:00100000:1.0:1789427741.563362:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877058048 00000100:00100000:1.0:1789427741.563433:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789427741.563443:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877058048:12345-0@lo:502: 00000100:00100000:1.0:1789427741.563754:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877058048:12345-0@lo:502: Request processed in 311us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.563761:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789427741.563877:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877058048:0@lo:502: 00000040:00080000:0.0:1789427741.564157:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789427741.564249:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789427741.564283:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789427741.564326:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789427741.564360:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789427741.564405:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789427741.564440:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789427741.564473:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789427741.564519:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789427741.564556:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789427741.564587:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789427741.564647:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789427741.564686:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789427741.564719:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789427741.564780:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789427741.564832:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789427741.564865:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789427741.564908:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789427741.564942:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789427741.564970:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789427741.565008:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789427741.565036:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789427741.565062:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789427741.565100:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789427741.565139:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789427741.565166:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789427741.565233:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789427741.565261:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789427741.565288:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789427741.565342:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789427741.565379:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789427741.565424:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789427741.565453:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789427741.565495:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789427741.565529:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789427741.565570:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789427741.565601:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789427741.565661:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877058176:0@lo:502: 00000100:00100000:0.0:1789427741.565728:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427741.565760:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340822f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427741.566149:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877058176 00000100:00100000:2.0:1789427741.566159:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877058176 00000100:00100000:2.0:1789427741.566234:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789427741.566243:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877058176:12345-0@lo:502: 00000100:00100000:2.0:1789427741.566481:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877058176:12345-0@lo:502: Request processed in 238us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427741.566490:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789427741.566931:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877058176:0@lo:502: 00000040:00080000:0.0:1789427741.567029:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1789427741.567042:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789427741.568090:0:7633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789427741.568131:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93341deb4d40) 00000020:00000080:0.0:1789427741.568154:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789427741.568259:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93341d0db000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789427741.568263:0:7633:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93341d0db000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789427741.568265:0:7633:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93341d0db000 3 00010000:00080000:0.0:1789427741.568298:0:7633:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933406acb800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.155@tcp at head 00010000:00010000:0.0:1789427741.570000:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789427741.570224:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789427741.570259:0:7633:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789427741.570271:0:7633:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2bea1a57ca34323b 00000100:00080000:0.0:1789427741.570288:0:7633:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789427741.570298:0:7633:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff933406acb800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789427741.570335:0:7633:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343ae60380 x1876350877058304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789427741.570354:0:7633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789427741.572315:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876350877058304:0@lo:38: 00000100:00100000:1.0:1789427741.572393:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.572470:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877058304 00000100:00100000:1.0:1789427741.572478:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877058304 00000100:00100000:1.0:1789427741.572516:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789427741.572522:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876350877058304:12345-0@lo:38: 00010000:00080000:1.0:1789427741.572551:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:1.0:1789427741.572593:0:5836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2bea1a57ca343242 00000004:00100000:1.0:1789427741.572610:0:5836:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789427741.572753:0:5836:0:(import.c:65:import_set_state_nolock()) ffff93341da36000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789427741.572806:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1876350877058304:12345-0@lo:38: Request processed in 282us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427741.572814:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789427741.572954:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343ae60380 x1876350877058304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427741.572965:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789427741.572973:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789427741.572980:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789427741.572984:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789427741.572987:0:3297:0:(import.c:65:import_set_state_nolock()) ffff933406acb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789427741.572993:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876350877058304:0@lo:38: 00000100:00100000:2.0:1789427741.574600:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427741.574629:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877058432:0@lo:400: 00000100:00100000:2.0:1789427741.574684:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427741.574725:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877058560:0@lo:400: 00000100:00100000:2.0:1789427741.574746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427741.574764:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427741.574768:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877058688:0@lo:400: 00000100:00100000:2.0:1789427741.574791:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427741.574822:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877058432 00000100:00100000:2.0:1789427741.574830:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877058432 00000100:00100000:2.0:1789427741.574869:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877058560 00000100:00100000:2.0:1789427741.574873:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877058560 00000100:00100000:2.0:1789427741.574898:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789427741.574905:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877058432:12345-0@lo:400: 00000100:00100000:2.0:1789427741.574949:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877058432:12345-0@lo:400: Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427741.574956:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789427741.574973:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789427741.574979:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877058560:12345-0@lo:400: 00000100:00100000:2.0:1789427741.575008:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877058560:12345-0@lo:400: Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427741.575024:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789427741.575045:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877058688 00000100:00100000:2.0:1789427741.575049:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877058688 00000100:00100000:2.0:1789427741.575077:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789427741.575084:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877058688:12345-0@lo:400: 00000100:00100000:2.0:1789427741.575114:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877058688:12345-0@lo:400: Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427741.575120:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789427741.575135:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427741.575139:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789427741.575160:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933420ed1880 x1876350877058432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427741.575397:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877058432:0@lo:400: 00010000:00080000:2.0:1789427741.576334:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933420ed0700 x1876350877058688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427741.576349:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877058688:0@lo:400: 00010000:00080000:2.0:1789427741.576360:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933420ed3100 x1876350877058560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427741.576369:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877058560:0@lo:400: 00000040:00080000:3.0:1789427741.582500:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1789427741.583306:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b903b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7635:1876350877058816:0@lo:901: 00000100:00100000:3.0:1789427741.583389:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.583435:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789427741.583678:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877058816 00000100:00100000:0.0:1789427741.583686:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877058816 00000100:00100000:0.0:1789427741.583752:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789427741.583761:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7635:x1876350877058816:12345-0@lo:901: 00000100:00100000:0.0:1789427741.584056:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7635:x1876350877058816:12345-0@lo:901: Request processed in 296us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427741.584065:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789427741.584111:0:7635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343b903b80 x1876350877058816/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789427757 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427741.584125:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b903b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7635:1876350877058816:0@lo:901: 00000100:00080000:3.0:1789427741.584763:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1789427741.584835:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789427741.584867:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789427741.584924:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.584937:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789427741.584991:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789427741.584993:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789427741.584995:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427741.584996:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427741.584998:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427741.584999:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427741.585000:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427741.585002:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427741.585004:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427741.585006:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427741.585007:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789427741.585011:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789427741.585013:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789427741.585015:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789427741.585016:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427741.585017:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427741.585018:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427741.585019:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427741.585020:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427741.585021:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427741.585022:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427741.585023:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427741.585024:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789427741.585046:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789427741.585060:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877058944:0@lo:253: 00000100:00100000:1.0:1789427741.585103:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427741.585147:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c378540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427741.585682:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877058944 00000100:00100000:2.0:1789427741.585691:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877058944 00000100:00100000:2.0:1789427741.585764:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789427741.585773:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:7619:x1876350877058944:12345-0@lo:253: 20000000:01000000:2.0:1789427741.585795:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789427741.585809:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789427741.616023:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789427741.616075:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789427741.619106:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789427741.619126:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789427741.619150:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.619169:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343193 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.619203:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.619252:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343193 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427741.619266:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343193 expref: 14 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427741.619279:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1876350877059072:0@lo:104: 00000100:00100000:2.0:1789427741.619348:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427741.619405:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427741.619535:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877059072 00000100:00100000:3.0:1789427741.619545:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877059072 00000100:00100000:3.0:1789427741.619600:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427741.619610:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5850:x1876350877059072:12345-0@lo:104: 00010000:00010000:3.0:1789427741.619633:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.619698:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789427741.619704:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:5850:x1876350877059072:12345-0@lo:104: Request processed in 97us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.619712:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789427741.619736:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427741.619742:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.619750:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c7400 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:3.0:1789427741.619754:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.619764:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789427741.619772:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427741.619777:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789427741.619821:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.619828:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789427741.619844:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.619851:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff9334421c7400/0x2bea1a57ca343193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34319a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.619866:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427741.619868:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427741.619869:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427741.619884:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427741.619896:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877059200:0@lo:103: 00000100:00100000:3.0:1789427741.619925:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427741.619954:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877059200 00000100:00100000:3.0:1789427741.619958:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877059200 00010000:00010000:3.0:1789427741.619975:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343193 expref: 15 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427741.619998:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427741.620004:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334081e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:3299:x1876350877059200:12345-0@lo:103: 00010000:00010000:3.0:1789427741.620014:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427741.620019:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343193 expref: 15 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620030:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343193 expref: 15 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620045:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620059:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789427741.620072:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001678798s 00010000:00010000:3.0:1789427741.620077:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620084:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620091:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620097:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620102:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02ae00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789427741.620107:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620114:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620122:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427741.620133:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427741.620163:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334081e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:3299:x1876350877059200:12345-0@lo:103: Request processed in 160us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427741.620170:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427741.620277:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877059200:0@lo:103: 00010000:00010000:1.0:1789427741.620455:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400031000/0x2bea1a57ca34319a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343193 expref: 14 pid: 5828 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427741.620467:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1876350877059072:0@lo:104: 00010000:00010000:1.0:1789427741.620483:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.620498:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.620504:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427741.620510:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca343249 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427741.627740:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:7619:x1876350877058944:12345-0@lo:253: Request processed in 41959us (42627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427741.627756:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789427741.627848:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:7619:1876350877058944:0@lo:253: 10000000:01000000:1.0:1789427741.627864:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789427741.627867:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789427741.627869:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789427741.627870:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427741.627872:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427741.627873:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427741.627874:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427741.627876:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427741.627877:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789427741.627878:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789427741.627880:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427741.627882:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789427741.627897:0:7619:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789427741.634959:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789427741.635155:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789427741.635726:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789427741.635895:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789427741.636486:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789427741.636756:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789427741.637907:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789427741.889869:0:7619:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789427741.889879:0:7619:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789427741.889936:0:7619:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789427741.890001:0:7619:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789427741.890018:0:7619:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789427741.890054:0:7619:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789427741.903936:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427742.921373:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427743.950217:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427744.714967:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427744.714993:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877059328:0@lo:13: 00000100:00100000:2.0:1789427744.715151:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427744.715280:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877059328 00000100:00100000:3.0:1789427744.715290:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877059328 00000100:00100000:3.0:1789427744.715367:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789427744.715377:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877059328:12345-0@lo:13: 00002000:00000024:3.0:1789427744.715413:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427744.715462:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877059328:12345-0@lo:13: Request processed in 86us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427744.715469:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789427744.715513:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933420ed1880 x1876350877059328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427744.715530:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877059328:0@lo:13: 00000100:00080000:2.0:1789427744.715648:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789427744.969381:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427745.993496:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427746.771596:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877059584:0@lo:400: 00000100:00100000:3.0:1789427746.771688:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427746.771750:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789427746.771757:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877059456:0@lo:400: 00000100:00100000:3.0:1789427746.771787:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427746.771809:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877059968:0@lo:400: 00000100:00100000:3.0:1789427746.771831:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427746.771858:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877059712:0@lo:400: 00000100:00100000:3.0:1789427746.771884:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427746.771900:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427746.771904:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877059840:0@lo:400: 00000100:00100000:3.0:1789427746.771924:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427746.771970:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877059584 00000100:00100000:3.0:1789427746.771978:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877059584 00000100:00100000:3.0:1789427746.772016:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877059968 00000100:00100000:3.0:1789427746.772019:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877059968 00000100:00100000:3.0:1789427746.772040:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877059712 00000100:00100000:3.0:1789427746.772043:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877059712 00000100:00100000:3.0:1789427746.772062:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789427746.772069:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877059584:12345-0@lo:400: 00000100:00100000:3.0:1789427746.772118:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877059584:12345-0@lo:400: Request processed in 49us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427746.772125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789427746.772143:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789427746.772149:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877059968:12345-0@lo:400: 00000100:00100000:3.0:1789427746.772212:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877059968:12345-0@lo:400: Request processed in 25us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427746.772219:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789427746.772232:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789427746.772239:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877059712:12345-0@lo:400: 00000100:00100000:3.0:1789427746.772267:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877059712:12345-0@lo:400: Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427746.772273:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789427746.772288:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877059456 00000100:00100000:3.0:1789427746.772291:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877059456 00000100:00100000:3.0:1789427746.772310:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789427746.772315:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:3301:x1876350877059456:12345-0@lo:400: 00000100:00100000:3.0:1789427746.772346:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:3301:x1876350877059456:12345-0@lo:400: Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427746.772351:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789427746.772393:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877059840 00000100:00100000:3.0:1789427746.772396:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877059840 00000100:00100000:3.0:1789427746.772422:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789427746.772428:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877059840:12345-0@lo:400: 00000100:00100000:3.0:1789427746.772456:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877059840:12345-0@lo:400: Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427746.772462:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789427746.772475:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427746.772480:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789427746.772520:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b900700 x1876350877059840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427746.772546:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877059840:0@lo:400: 00010000:00080000:3.0:1789427746.772558:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b901c00 x1876350877059712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427746.772566:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877059712:0@lo:400: 00000100:00100000:3.0:1789427746.772600:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877059456:0@lo:400: 00010000:00080000:3.0:1789427746.772609:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b900e00 x1876350877059968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427746.772617:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877059968:0@lo:400: 00010000:00080000:3.0:1789427746.772625:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b902300 x1876350877059584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427746.772632:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877059584:0@lo:400: 00010000:00010000:3.0:1789427747.021139:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427748.042225:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789427748.370018:0:7977:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789427749.065295:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427749.833465:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427749.833505:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877060096:0@lo:13: 00000100:00100000:1.0:1789427749.833578:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427749.833684:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877060096 00000100:00100000:2.0:1789427749.833692:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877060096 00000100:00080000:1.0:1789427749.833728:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427749.833740:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789427749.833748:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877060096:12345-0@lo:13: 00002000:00000024:2.0:1789427749.833777:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427749.833831:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877060096:12345-0@lo:13: Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427749.833840:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789427749.833990:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933420ed1880 x1876350877060096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427749.834016:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877060096:0@lo:13: 00010000:00010000:3.0:1789427750.089803:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789427750.349061:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789427750.349071:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933406156800 from 30 10000000:01000000:0.0:1789427750.349097:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789427750.349155:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.349170:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.349199:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.349227:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060224:0@lo:101: 00000100:00100000:0.0:1789427750.349318:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.349378:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.349409:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877060224 00000100:00100000:0.0:1789427750.349418:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877060224 00000100:00100000:0.0:1789427750.349489:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789427750.349500:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877060224:12345-0@lo:101: 00010000:00010000:0.0:1789427750.349515:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427750.349530:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343250 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.349558:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343250 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.349570:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343250 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.349579:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031e00, rc 0) 00000100:00100000:0.0:1789427750.349624:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877060224:12345-0@lo:101: Request processed in 126us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.349652:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789427750.349705:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060224:0@lo:101: 00010000:00010000:0.0:1789427750.349720:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.349729:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.349785:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060352:0@lo:501: 00000100:00100000:0.0:1789427750.349811:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.349825:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427750.350240:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877060352 00000100:00100000:1.0:1789427750.350246:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877060352 00000100:00100000:1.0:1789427750.350280:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789427750.350287:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877060352:12345-0@lo:501: 00000100:00100000:1.0:1789427750.350741:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877060352:12345-0@lo:501: Request processed in 452us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427750.350749:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789427750.350790:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060352:0@lo:501: 00000100:00100000:1.0:1789427750.350828:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060480:0@lo:503: 00000100:00100000:1.0:1789427750.351771:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.351813:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411be4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427750.351833:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877060480 00000100:00100000:1.0:1789427750.351840:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877060480 00000100:00100000:1.0:1789427750.351970:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789427750.351979:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877060480:12345-0@lo:503: 00000100:00100000:1.0:1789427750.352377:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877060480:12345-0@lo:503: Request processed in 397us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427750.352386:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789427750.352444:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060480:0@lo:503: 00000100:00100000:1.0:1789427750.355791:0:8076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8076:1876350877060608:0@lo:502: 00000100:00100000:1.0:1789427750.356065:0:8076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.356124:0:8076:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.356400:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877060608 00000100:00100000:2.0:1789427750.356410:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877060608 00000100:00100000:2.0:1789427750.356482:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789427750.356493:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:8076:x1876350877060608:12345-0@lo:502: 00000100:00100000:2.0:1789427750.356911:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:8076:x1876350877060608:12345-0@lo:502: Request processed in 418us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.356921:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789427750.357162:0:8076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8076:1876350877060608:0@lo:502: 00000100:00100000:1.0:1789427750.357271:0:8076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8076:1876350877060736:0@lo:502: 00000100:00100000:1.0:1789427750.357314:0:8076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427750.357354:0:8076:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.357454:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877060736 00000100:00100000:0.0:1789427750.357472:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877060736 00000100:00100000:0.0:1789427750.357511:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789427750.357521:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:8076:x1876350877060736:12345-0@lo:502: 00000100:00100000:0.0:1789427750.357734:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:8076:x1876350877060736:12345-0@lo:502: Request processed in 213us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.357742:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789427750.359329:0:8076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8076:1876350877060736:0@lo:502: 00000040:00080000:1.0:1789427750.359387:0:8076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789427750.362893:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789427750.362944:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789427750.362958:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.362973:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427750.362985:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789427750.362989:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789427750.362992:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789427750.363045:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.363070:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.363085:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427750.363115:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060864:0@lo:101: 00000100:00100000:2.0:1789427750.363225:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.363277:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.363321:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877060864 00000100:00100000:2.0:1789427750.363330:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877060864 00000100:00100000:3.0:1789427750.363565:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789427750.363577:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877060864:12345-0@lo:101: 00010000:00010000:3.0:1789427750.363595:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427750.363611:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34325e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.363652:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34325e expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.363665:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34325e expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.363674:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527c00, rc 0) 00000100:00100000:3.0:1789427750.363724:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877060864:12345-0@lo:101: Request processed in 149us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.363731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789427750.370632:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060864:0@lo:101: 00010000:00010000:3.0:1789427750.370686:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.370702:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427750.370807:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060992:0@lo:501: 00000100:00100000:3.0:1789427750.370900:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.370947:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.373448:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877060992 00000100:00100000:3.0:1789427750.378041:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877060992 00000100:00100000:3.0:1789427750.378137:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789427750.378150:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877060992:12345-0@lo:501: 00000100:00100000:3.0:1789427750.379033:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877060992:12345-0@lo:501: Request processed in 879us (8126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.379045:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789427750.396593:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877060992:0@lo:501: 00000100:00100000:2.0:1789427750.396830:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877061120:0@lo:503: 00000100:00100000:2.0:1789427750.396947:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.397035:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.408621:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877061120 00000100:00100000:0.0:1789427750.408656:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877061120 00000100:00100000:0.0:1789427750.408737:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789427750.408749:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877061120:12345-0@lo:503: 00000100:00100000:0.0:1789427750.409301:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877061120:12345-0@lo:503: Request processed in 553us (12352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.409311:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789427750.411600:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877061120:0@lo:503: 00000100:00100000:2.0:1789427750.411913:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8080:1876350877061248:0@lo:502: 00000100:00100000:2.0:1789427750.411999:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.412047:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.415790:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877061248 00000100:00100000:2.0:1789427750.415813:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877061248 00000100:00100000:2.0:1789427750.415892:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789427750.415905:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:8080:x1876350877061248:12345-0@lo:502: 00000100:00100000:2.0:1789427750.416374:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:8080:x1876350877061248:12345-0@lo:502: Request processed in 468us (4372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.416404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789427750.416489:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8080:1876350877061248:0@lo:502: 00000020:01000000:2.0:1789427750.416533:0:8080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427750.416545:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427750.416547:0:8080:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789427750.416552:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789427750.416554:0:8080:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789427750.416593:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8080:1876350877061376:0@lo:502: 00000100:00100000:2.0:1789427750.417751:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.417827:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.418064:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877061376 00000100:00100000:0.0:1789427750.418084:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877061376 00000100:00100000:0.0:1789427750.418138:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789427750.418147:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:8080:x1876350877061376:12345-0@lo:502: 00000100:00100000:0.0:1789427750.418478:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:8080:x1876350877061376:12345-0@lo:502: Request processed in 330us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.418488:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789427750.419587:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8080:1876350877061376:0@lo:502: 00000020:01000000:2.0:1789427750.419718:0:8080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427750.419729:0:8080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427750.419732:0:8080:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789427750.419738:0:8080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789427750.419997:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789427750.420026:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789427750.420040:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.420054:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427750.420066:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789427750.420070:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933433d9c800 from 30 10000000:01000000:0.0:1789427750.420074:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789427750.420139:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.420149:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.420160:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.420204:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877061504:0@lo:101: 00000100:00100000:0.0:1789427750.420280:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.420323:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be600 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.420342:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877061504 00000100:00100000:0.0:1789427750.420359:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877061504 00000100:00100000:0.0:1789427750.420602:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789427750.420613:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877061504:12345-0@lo:101: 00010000:00010000:0.0:1789427750.420629:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427750.421756:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34326c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.421800:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34326c expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.421814:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34326c expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.421824:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:0.0:1789427750.421929:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877061504:12345-0@lo:101: Request processed in 1317us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.421939:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789427750.422552:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877061504:0@lo:101: 00010000:00010000:2.0:1789427750.422576:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.422587:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427750.424570:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877061632:0@lo:501: 00000100:00100000:2.0:1789427750.425606:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.426798:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.427202:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877061632 00000100:00100000:3.0:1789427750.427218:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877061632 00000100:00100000:3.0:1789427750.427299:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789427750.427310:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877061632:12345-0@lo:501: 00000100:00100000:3.0:1789427750.429299:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877061632:12345-0@lo:501: Request processed in 1978us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.429315:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789427750.429603:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877061632:0@lo:501: 00000100:00100000:2.0:1789427750.429738:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877061760:0@lo:503: 00000100:00100000:2.0:1789427750.429798:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.429832:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.430728:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877061760 00000100:00100000:3.0:1789427750.430740:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877061760 00000100:00100000:3.0:1789427750.430805:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789427750.430815:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877061760:12345-0@lo:503: 00000100:00100000:3.0:1789427750.433750:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877061760:12345-0@lo:503: Request processed in 2927us (3942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.433768:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789427750.433996:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877061760:0@lo:503: 00000100:00100000:3.0:1789427750.436669:0:8083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8083:1876350877061888:0@lo:502: 00000100:00100000:3.0:1789427750.436772:0:8083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.436823:0:8083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427750.436988:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877061888 00000100:00100000:1.0:1789427750.436998:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877061888 00000100:00100000:1.0:1789427750.437059:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789427750.437069:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:8083:x1876350877061888:12345-0@lo:502: 00000100:00100000:1.0:1789427750.437486:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:8083:x1876350877061888:12345-0@lo:502: Request processed in 417us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427750.437495:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789427750.437614:0:8083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8083:1876350877061888:0@lo:502: 00000100:00100000:3.0:1789427750.437677:0:8083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8083:1876350877062016:0@lo:502: 00000100:00100000:3.0:1789427750.437713:0:8083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.439810:0:8083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.440779:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877062016 00000100:00100000:2.0:1789427750.440796:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877062016 00000100:00100000:2.0:1789427750.441557:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789427750.441577:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:8083:x1876350877062016:12345-0@lo:502: 00000100:00100000:2.0:1789427750.442623:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:8083:x1876350877062016:12345-0@lo:502: Request processed in 1047us (4902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.442639:0:8083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8083:1876350877062016:0@lo:502: 00000040:00080000:3.0:1789427750.442697:0:8083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:2.0:1789427750.443035:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000020:01000000:2.0:1789427750.443073:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789427750.443095:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789427750.443106:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.443119:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427750.443131:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789427750.443134:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933433d9c800 from 5 10000000:01000000:2.0:1789427750.443137:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789427750.443605:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.443615:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.443628:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427750.443726:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062144:0@lo:101: 00000100:00100000:2.0:1789427750.443805:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.444114:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.444151:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877062144 00000100:00100000:2.0:1789427750.444160:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877062144 00000100:00100000:2.0:1789427750.444303:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789427750.444315:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877062144:12345-0@lo:101: 00010000:00010000:2.0:1789427750.444333:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427750.444352:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02ac00/0x2bea1a57ca343281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34327a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.444394:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02ac00/0x2bea1a57ca343281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34327a expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.444408:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02ac00/0x2bea1a57ca343281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34327a expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427750.444418:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02ac00, rc 0) 00000100:00100000:2.0:1789427750.444478:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877062144:12345-0@lo:101: Request processed in 166us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.444485:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789427750.444617:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062144:0@lo:101: 00010000:00010000:0.0:1789427750.444633:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.444643:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.444704:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062272:0@lo:256: 00000100:00100000:0.0:1789427750.444741:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.445104:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be900 going to sleep for 11 seconds 00000100:00100000:1.0:1789427750.445321:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877062272 00000100:00100000:1.0:1789427750.445328:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877062272 00000100:00100000:1.0:1789427750.445410:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789427750.445419:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877062272:12345-0@lo:256: 20000000:01000000:1.0:1789427750.445437:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789427750.445474:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789427750.445478:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789427750.445583:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877062272:12345-0@lo:256: Request processed in 165us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427750.445591:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789427750.446140:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062272:0@lo:256: 10000000:01000000:0.0:1789427750.446221:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789427750.446231:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.446242:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427750.446253:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789427750.446256:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789427750.446259:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789427750.446289:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.446297:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.446307:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.446324:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062400:0@lo:101: 00000100:00100000:0.0:1789427750.446359:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.454820:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be900 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.462810:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877062400 00000100:00100000:3.0:1789427750.462830:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877062400 00000100:00100000:3.0:1789427750.463104:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789427750.463116:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877062400:12345-0@lo:101: 00010000:00010000:3.0:1789427750.463140:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427750.463164:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343288 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.463253:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343288 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.463265:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343288 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.463275:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527600, rc 0) 00000100:00100000:3.0:1789427750.463481:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877062400:12345-0@lo:101: Request processed in 366us (17119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.463488:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789427750.466703:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062400:0@lo:101: 00010000:00010000:0.0:1789427750.466743:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427750.466760:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427750.466899:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062528:0@lo:501: 00000100:00100000:0.0:1789427750.466973:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.467025:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be900 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.467111:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877062528 00000100:00100000:3.0:1789427750.467120:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877062528 00000100:00100000:3.0:1789427750.467224:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789427750.467255:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877062528:12345-0@lo:501: 00000100:00100000:3.0:1789427750.467692:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877062528:12345-0@lo:501: Request processed in 457us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.467701:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789427750.467734:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062528:0@lo:501: 00000100:00100000:2.0:1789427750.467772:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062656:0@lo:503: 00000100:00100000:2.0:1789427750.467819:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.467833:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877062656 00000100:00100000:0.0:1789427750.467838:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877062656 00000100:00100000:2.0:1789427750.467842:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789427750.467881:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789427750.467889:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877062656:12345-0@lo:503: 00000100:00100000:0.0:1789427750.468276:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877062656:12345-0@lo:503: Request processed in 387us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.468284:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789427750.468305:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877062656:0@lo:503: 00000100:00100000:0.0:1789427750.472660:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae63800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8084:1876350877062784:0@lo:502: 00000100:00100000:0.0:1789427750.472782:0:8084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.472844:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be900 going to sleep for 11 seconds 00000100:00100000:1.0:1789427750.473250:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877062784 00000100:00100000:1.0:1789427750.473260:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877062784 00000100:00100000:1.0:1789427750.473322:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789427750.473333:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8084:x1876350877062784:12345-0@lo:502: 00000100:00100000:1.0:1789427750.474059:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8084:x1876350877062784:12345-0@lo:502: Request processed in 724us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427750.474079:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789427750.474546:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae63800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8084:1876350877062784:0@lo:502: 00000020:01000000:2.0:1789427750.474591:0:8084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789427750.474607:0:8084:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789427750.474616:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427750.474618:0:8084:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789427750.474624:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789427750.474628:0:8084:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.155@tcp to nid 0x20000c0a8c99b (192.168.201.155@tcp) 00000020:01000000:2.0:1789427750.474669:0:8084:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789427750.474672:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789427750.474690:0:8084:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff933420f319c0) 00000020:00000080:2.0:1789427750.474717:0:8084:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789427750.474723:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789427750.474843:0:8084:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789427750.474850:0:8084:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789427750.474858:0:8084:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca34329d 00010000:00080000:2.0:1789427750.474895:0:8084:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93341004e800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.155@tcp at head 00010000:00010000:2.0:1789427750.475163:0:8084:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789427750.475965:0:8084:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789427750.475986:0:8084:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789427750.481345:0:8084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789427750.481922:0:8084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789427750.481972:0:8084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789427750.482018:0:8084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789427750.482732:0:8085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427750.482739:0:8085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789427750.490964:0:8084:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789427750.490984:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789427750.491039:0:8084:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789427750.491070:0:8084:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca3432a4 00000100:00080000:1.0:1789427750.491083:0:8084:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789427750.491097:0:8084:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93341004e800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:1.0:1789427750.491138:0:8084:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933406143100 x1876350877062912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427750.491229:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877062912:0@lo:8: 00000100:00100000:2.0:1789427750.491638:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.491785:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877062912 00000100:00100000:3.0:1789427750.491794:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877062912 00000100:00100000:3.0:1789427750.491858:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789427750.491868:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1876350877062912:12345-0@lo:8: 00010000:00080000:3.0:1789427750.491903:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:3.0:1789427750.491941:0:6684:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca3432ab 00002000:00100000:3.0:1789427750.491958:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff933420e25800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789427750.491963:0:6684:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789427750.491968:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789427750.492150:0:6684:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789427750.492405:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789427750.492436:0:6684:0:(import.c:65:import_set_state_nolock()) ffff933420e24000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789427750.493039:0:8084:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789427750.493081:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1876350877062912:12345-0@lo:8: Request processed in 1210us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.493091:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:1.0:1789427750.493146:0:8084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427750.493154:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427750.493156:0:8084:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789427750.493159:0:8084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427750.493164:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427750.493166:0:8084:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789427750.493168:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789427750.493170:0:8084:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00010000:00080000:2.0:1789427750.493251:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933406143100 x1876350877062912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789427760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.493265:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789427750.493275:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789427750.493286:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789427750.493310:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789427750.493314:0:3297:0:(import.c:65:import_set_state_nolock()) ffff93341004e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789427750.493340:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8084:1876350877063040:0@lo:502: 00000004:00080000:2.0:1789427750.493366:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789427750.493373:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877062912:0@lo:8: 00000100:00100000:0.0:1789427750.493498:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877063424:0@lo:400: 00000004:00080000:3.0:1789427750.493547:0:8085:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789427750.493553:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.493562:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877063168:0@lo:400: 00000100:00100000:0.0:1789427750.493589:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427750.493594:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.493595:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877063552:0@lo:400: 00000100:00100000:3.0:1789427750.493615:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427750.493615:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.493620:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877063296:0@lo:400: 00000100:00100000:3.0:1789427750.493639:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.493673:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877063168 00000100:00100000:3.0:1789427750.493679:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877063168 00000100:00100000:3.0:1789427750.493713:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877063552 00000100:00100000:3.0:1789427750.493716:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877063552 00000100:00100000:1.0:1789427750.493737:0:8084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.493742:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877063296 00000100:00100000:3.0:1789427750.493745:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877063296 00000100:00100000:3.0:1789427750.493759:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789427750.493763:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.493766:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877063168:12345-0@lo:400: 00000100:00100000:3.0:1789427750.493819:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877063168:12345-0@lo:400: Request processed in 53us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.493826:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789427750.493841:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789427750.494033:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877063424 00000100:00100000:2.0:1789427750.494037:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877063424 00000100:00100000:2.0:1789427750.494079:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789427750.494087:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877063424:12345-0@lo:400: 00000100:00100000:2.0:1789427750.494126:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877063424:12345-0@lo:400: Request processed in 40us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.494132:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789427750.494330:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae61180 x1876350877063424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427750.494343:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877063424:0@lo:400: 00000100:00100000:3.0:1789427750.494775:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877063552:12345-0@lo:400: 00000100:00100000:3.0:1789427750.494836:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877063552:12345-0@lo:400: Request processed in 989us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.495041:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789427750.495087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789427750.495097:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877063296:12345-0@lo:400: 00000100:00100000:3.0:1789427750.495132:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877063296:12345-0@lo:400: Request processed in 37us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.495138:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789427750.495165:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789427750.495569:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae61500 x1876350877063296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427750.495583:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877063296:0@lo:400: 00010000:00080000:3.0:1789427750.495595:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae63100 x1876350877063168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427750.495603:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877063168:0@lo:400: 00000100:00100000:3.0:1789427750.495638:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877063040 00000100:00100000:3.0:1789427750.495644:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877063040 00000100:00100000:3.0:1789427750.495690:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789427750.495698:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8084:x1876350877063040:12345-0@lo:502: 00000004:00080000:2.0:1789427750.496087:0:8085:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 205430910166ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789427750.496352:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8084:x1876350877063040:12345-0@lo:502: Request processed in 653us (2612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.496370:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789427750.496624:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8084:1876350877063040:0@lo:502: 00000020:01000000:3.0:1789427750.496660:0:8084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427750.496669:0:8084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427750.496671:0:8084:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789427750.496678:0:8084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1789427750.496837:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789427750.497088:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789427750.497100:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.497113:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427750.497124:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789427750.497127:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9334101b3380 from 1 10000000:01000000:3.0:1789427750.497131:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789427750.497169:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789427750.497723:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae60a80 x1876350877063552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427750.497741:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877063552:0@lo:400: 00010000:00010000:3.0:1789427750.497900:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.497913:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427750.497938:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b901c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877063680:0@lo:101: 00000100:00100000:3.0:1789427750.498002:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.498044:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.498086:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877063680 00000100:00100000:3.0:1789427750.498094:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877063680 00000100:00100000:3.0:1789427750.498139:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789427750.498148:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877063680:12345-0@lo:101: 00010000:00010000:3.0:1789427750.498164:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427750.498208:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3432b2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.498236:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3432b2 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.498248:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3432b2 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.498257:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401526200, rc 0) 00000100:00100000:3.0:1789427750.498295:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877063680:12345-0@lo:101: Request processed in 147us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.498301:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789427750.498338:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b901c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877063680:0@lo:101: 00010000:00010000:3.0:1789427750.498351:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.498361:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427750.498706:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b901c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877063808:0@lo:501: 00000100:00100000:3.0:1789427750.498738:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427750.498811:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.498860:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877063808 00000100:00100000:2.0:1789427750.498865:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877063808 00000100:00100000:2.0:1789427750.498895:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789427750.498903:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877063808:12345-0@lo:501: 00000100:00100000:2.0:1789427750.499163:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877063808:12345-0@lo:501: Request processed in 260us (424us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789427750.499171:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789427750.499344:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b901c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877063808:0@lo:501: 10000000:01000000:3.0:1789427750.499491:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789427750.499499:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427750.499509:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427750.595475:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427750.595509:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877063936:0@lo:13: 00000100:00100000:1.0:1789427750.595606:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789427750.595699:0:8086:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789427750.595729:0:8086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1876350877064064:0@lo:7: 00000100:00100000:1.0:1789427750.595756:0:8086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.595778:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877063936 00000100:00100000:1.0:1789427750.595780:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877064064 00000100:00100000:2.0:1789427750.595787:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877063936 00000100:00100000:1.0:1789427750.595787:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877064064 00000100:00100000:2.0:1789427750.595852:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789427750.595865:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427750.600372:0:8086:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.602542:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876350877063936:12345-0@lo:13: 00000100:00100000:0.0:1789427750.602582:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789427750.602596:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8086:x1876350877064064:12345-0@lo:7: 00002000:00000024:2.0:1789427750.602601:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789427750.603253:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876350877063936:12345-0@lo:13: Request processed in 7389us (7644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427750.603264:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789427750.612377:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933406143800 x1876350877063936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427750.612417:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877063936:0@lo:13: 00002000:00080000:0.0:1789427750.616304:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789427750.616316:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789427750.616465:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8086:x1876350877064064:12345-0@lo:7: Request processed in 13858us (20692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427750.616479:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789427750.616780:0:8086:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933406142d80 x1876350877064064/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.616799:0:8086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1876350877064064:0@lo:7: 00000004:00080000:2.0:1789427750.616819:0:8086:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789427750.616876:0:8086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1876350877064192:0@lo:5: 00000100:00100000:2.0:1789427750.616915:0:8086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.617071:0:8086:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427750.619087:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877064192 00000100:00100000:1.0:1789427750.619107:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877064192 00000100:00100000:1.0:1789427750.620564:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789427750.620592:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8086:x1876350877064192:12345-0@lo:5: 00002000:00080000:1.0:1789427750.620651:0:6685:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789427750.620656:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789427750.621325:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8086:x1876350877064192:12345-0@lo:5: Request processed in 743us (4405us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789427750.621336:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789427750.623565:0:8086:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933420ed1880 x1876350877064192/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.623596:0:8086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1876350877064192:0@lo:5: 00000004:00080000:2.0:1789427750.623617:0:8086:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789427750.624532:0:8086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f956300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1876350877064320:0@lo:700: 00000100:00100000:2.0:1789427750.624619:0:8086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.624749:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877064320 00000100:00100000:2.0:1789427750.624758:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877064320 00000100:00100000:2.0:1789427750.624831:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427750.624841:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8086:x1876350877064320:12345-0@lo:700: 00000100:00100000:2.0:1789427750.624886:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f956d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1876350877064448:0@lo:700: 00000100:00100000:2.0:1789427750.624923:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427750.624947:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341066ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.625561:0:8086:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427750.632849:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877064448 00000100:00100000:2.0:1789427750.632872:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877064448 00000100:00100000:2.0:1789427750.633554:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427750.633569:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1876350877064448:12345-0@lo:700: 00000004:00080000:0.0:1789427750.697101:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1789427750.768728:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789427750.776159:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1876350877064448:12345-0@lo:700: Request processed in 142471us (151111us total) trans 0 rc 0/0 00010000:00080000:2.0:1789427750.776339:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343f956d80 x1876350877064448/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.776360:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f956d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1876350877064448:0@lo:700: 40000000:02000000:2.0:1789427750.776379:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1789427750.777076:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1789427750.928757:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789427750.928783:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789427750.929149:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8086:x1876350877064320:12345-0@lo:700: Request processed in 304302us (304523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427750.929171:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789427750.929306:0:8086:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343f956300 x1876350877064320/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427750.929321:0:8086:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789427750.929342:0:8086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f956300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1876350877064320:0@lo:700: 00000004:02000040:0.0:1789427750.957466:0:8086:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789427750.962149:0:8086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1876350877064576:0@lo:5: 00000100:00100000:0.0:1789427750.962348:0:8086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427750.962415:0:8086:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789427750.962699:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877064576 00000100:00100000:3.0:1789427750.962709:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877064576 00000100:00100000:3.0:1789427750.962779:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789427750.962789:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8086:x1876350877064576:12345-0@lo:5: 00002000:00080000:0.0:1789427750.968443:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789427750.968484:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789427750.973284:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8086:x1876350877064576:12345-0@lo:5: Request processed in 10482us (10921us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789427750.973305:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789427750.973409:0:8086:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae61180 x1876350877064576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789427766 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427750.973433:0:8086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1876350877064576:0@lo:5: 00000004:00080000:2.0:1789427750.973463:0:8086:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789427751.114089:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427752.146152:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427753.167592:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789427753.791981:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1789427754.187804:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427754.342237:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427754.343909:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857117824 00000100:00100000:3.0:1789427754.343925:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857117824 00000100:00100000:3.0:1789427754.343977:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 112 00000100:00100000:3.0:1789427754.343986:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2353:x1876350857117824:12345-192.168.201.55@tcp:250: 00010000:00080000:3.0:1789427754.344017:0:5828:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5c70afe5-5dfb-4970-8818-ca41fe0a6309@192.168.201.55@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1789427754.344065:0:5828:0:(genops.c:1384:class_connect()) connect: client 5c70afe5-5dfb-4970-8818-ca41fe0a6309, cookie 0x2bea1a57ca3432c0 00000100:00080000:3.0:1789427754.344239:0:5828:0:(import.c:65:import_set_state_nolock()) ffff933420e20000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427754.344313:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+5:2353:x1876350857117824:12345-192.168.201.55@tcp:250: Request processed in 325us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427754.344320:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 112 00000100:00100000:0.0:1789427754.351896:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427754.351975:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857117952 00000100:00100000:2.0:1789427754.351986:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857117952 00000100:00100000:2.0:1789427754.352043:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 113 00000100:00100000:2.0:1789427754.352053:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+5:5581:x1876350857117952:12345-192.168.201.55@tcp:101: 00010000:00010000:2.0:1789427754.352072:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427754.352091:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a85e4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427754.352122:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a85e4 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427754.352133:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a85e4 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427754.352142:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a000, rc 0) 00000100:00100000:2.0:1789427754.352219:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+6:5581:x1876350857117952:12345-192.168.201.55@tcp:101: Request processed in 167us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427754.352239:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 113 00000100:00100000:3.0:1789427754.360667:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427754.361684:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857118080 00000100:00100000:1.0:1789427754.361698:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857118080 00000100:00100000:1.0:1789427754.361756:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 114 00000100:00100000:1.0:1789427754.361768:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+6:5581:x1876350857118080:12345-192.168.201.55@tcp:501: 00000100:00100000:1.0:1789427754.362113:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+6:5581:x1876350857118080:12345-192.168.201.55@tcp:501: Request processed in 346us (1454us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427754.362129:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 114 00000100:00100000:1.0:1789427754.367757:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427754.367889:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857118208 00000100:00100000:0.0:1789427754.367902:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857118208 00000100:00100000:0.0:1789427754.367967:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 115 00000100:00100000:0.0:1789427754.367978:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+6:5581:x1876350857118208:12345-192.168.201.55@tcp:101: 00010000:00010000:0.0:1789427754.367995:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427754.368014:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a85eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427754.368043:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a85eb expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427754.368072:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a85eb expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427754.368082:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031c00, rc 0) 00000100:00100000:0.0:1789427754.368133:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+7:5581:x1876350857118208:12345-192.168.201.55@tcp:101: Request processed in 157us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427754.368141:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 115 00000100:00100000:0.0:1789427754.371380:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427754.371509:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857118336 00000100:00100000:2.0:1789427754.371521:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857118336 00000100:00100000:2.0:1789427754.371579:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 116 00000100:00100000:2.0:1789427754.371590:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+7:5581:x1876350857118336:12345-192.168.201.55@tcp:501: 00000100:00100000:2.0:1789427754.371880:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:5581:x1876350857118336:12345-192.168.201.55@tcp:501: Request processed in 290us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427754.371903:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 116 00000100:00100000:1.0:1789427754.381463:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427754.381655:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857118464 00000100:00100000:0.0:1789427754.381667:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857118464 00000100:00100000:0.0:1789427754.381725:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 117 00000100:00100000:0.0:1789427754.381736:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:5581:x1876350857118464:12345-192.168.201.55@tcp:503: 00000100:00100000:0.0:1789427754.382124:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:5581:x1876350857118464:12345-192.168.201.55@tcp:503: Request processed in 388us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427754.382131:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 117 00000100:00100000:2.0:1789427754.396143:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427754.398156:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857118592 00000100:00100000:3.0:1789427754.398185:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857118592 00000100:00100000:3.0:1789427754.398259:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 118 00000100:00100000:3.0:1789427754.398270:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:5600:x1876350857118592:12345-192.168.201.55@tcp:502: 00000100:00100000:3.0:1789427754.398742:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:5600:x1876350857118592:12345-192.168.201.55@tcp:502: Request processed in 472us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427754.398752:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 118 00000100:00100000:3.0:1789427754.433222:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427754.433657:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857118720 00000100:00100000:1.0:1789427754.433669:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857118720 00000100:00100000:1.0:1789427754.433718:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 119 00000100:00100000:1.0:1789427754.433728:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:5600:x1876350857118720:12345-192.168.201.55@tcp:502: 00000100:00100000:1.0:1789427754.434008:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:5600:x1876350857118720:12345-192.168.201.55@tcp:502: Request processed in 280us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427754.434016:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 119 00000100:00100000:0.0:1789427754.463172:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427754.463296:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857118848 00000100:00100000:3.0:1789427754.463316:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857118848 00000100:00100000:3.0:1789427754.463372:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 120 00000100:00100000:3.0:1789427754.463382:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:5581:x1876350857118848:12345-192.168.201.55@tcp:101: 00010000:00010000:3.0:1789427754.463408:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427754.463427:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401526000/0x2bea1a57ca3432d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8615 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427754.463456:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401526000/0x2bea1a57ca3432d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8615 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427754.463467:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401526000/0x2bea1a57ca3432d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8615 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427754.463475:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401526000, rc 0) 00000100:00100000:3.0:1789427754.463529:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5581:x1876350857118848:12345-192.168.201.55@tcp:101: Request processed in 149us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427754.463536:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 120 00000100:00100000:1.0:1789427754.478398:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427754.478495:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857118976 00000100:00100000:3.0:1789427754.478507:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857118976 00000100:00100000:3.0:1789427754.478583:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 121 00000100:00100000:3.0:1789427754.478593:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5581:x1876350857118976:12345-192.168.201.55@tcp:256: 20000000:01000000:3.0:1789427754.478620:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789427754.478639:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789427754.478643:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789427754.478646:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789427754.478649:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789427754.483578:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5581:x1876350857118976:12345-192.168.201.55@tcp:256: Request processed in 4967us (5183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427754.483593:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 121 00000100:00100000:0.0:1789427754.486765:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427754.486988:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857119104 00000100:00100000:3.0:1789427754.487001:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857119104 00000100:00100000:3.0:1789427754.487203:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 122 00000100:00100000:3.0:1789427754.487216:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5581:x1876350857119104:12345-192.168.201.55@tcp:101: 00010000:00010000:3.0:1789427754.487234:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427754.487252:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a861c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427754.487283:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a861c expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427754.487295:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a861c expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427754.487304:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527200, rc 0) 00000100:00100000:3.0:1789427754.487357:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5581:x1876350857119104:12345-192.168.201.55@tcp:101: Request processed in 144us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427754.487364:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 122 00000100:00100000:0.0:1789427754.495511:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427754.495553:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857119232 00000100:00100000:0.0:1789427754.495572:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857119232 00000100:00100000:0.0:1789427754.495626:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 123 00000100:00100000:0.0:1789427754.495635:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5581:x1876350857119232:12345-192.168.201.55@tcp:501: 00000100:00100000:0.0:1789427754.495907:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5581:x1876350857119232:12345-192.168.201.55@tcp:501: Request processed in 270us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427754.495914:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 123 00000100:00100000:0.0:1789427754.507366:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427754.507825:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857119360 00000100:00100000:3.0:1789427754.507836:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857119360 00000100:00100000:3.0:1789427754.507898:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 124 00000100:00100000:3.0:1789427754.507907:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5581:x1876350857119360:12345-192.168.201.55@tcp:503: 00000100:00100000:3.0:1789427754.508258:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5581:x1876350857119360:12345-192.168.201.55@tcp:503: Request processed in 350us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427754.508266:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 124 00000100:00100000:0.0:1789427754.513346:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427754.513379:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857119488 00000100:00100000:0.0:1789427754.513401:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857119488 00000100:00100000:0.0:1789427754.513447:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 125 00000100:00100000:0.0:1789427754.513456:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5605:x1876350857119488:12345-192.168.201.55@tcp:502: 00000100:00100000:0.0:1789427754.513702:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5605:x1876350857119488:12345-192.168.201.55@tcp:502: Request processed in 246us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427754.513710:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 125 00000100:00100000:0.0:1789427754.517619:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427754.517750:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857119616 00000100:00100000:2.0:1789427754.517761:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857119616 00000100:00100000:2.0:1789427754.517815:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 126 00000100:00100000:2.0:1789427754.517825:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5605:x1876350857119616:12345-192.168.201.55@tcp:502: 00000100:00100000:2.0:1789427754.518092:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5605:x1876350857119616:12345-192.168.201.55@tcp:502: Request processed in 267us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427754.518100:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 126 00000100:00100000:0.0:1789427754.522170:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427754.522335:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857119744 00000100:00100000:3.0:1789427754.522347:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857119744 00000100:00100000:3.0:1789427754.522414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:3.0:1789427754.522423:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1876350857119744:12345-192.168.201.55@tcp:38: 00010000:00080000:3.0:1789427754.522457:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1789427754.522509:0:5835:0:(genops.c:1384:class_connect()) connect: client 691432fe-93d9-4afe-b1ac-013e2024784c, cookie 0x2bea1a57ca3432e3 00000004:00100000:3.0:1789427754.522540:0:5835:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789427754.522546:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789427754.569155:0:5835:0:(import.c:65:import_set_state_nolock()) ffff933420e23000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427754.569256:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2353:x1876350857119744:12345-192.168.201.55@tcp:38: Request processed in 46831us (47096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427754.569266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:0.0:1789427754.953509:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427754.953535:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877064704:0@lo:13: 00000100:00100000:0.0:1789427754.953618:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427754.953763:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877064704 00000100:00100000:2.0:1789427754.953773:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877064704 00000100:00100000:2.0:1789427754.953839:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789427754.953848:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877064704:12345-0@lo:13: 00002000:00000024:2.0:1789427754.953892:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427754.953944:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877064704:12345-0@lo:13: Request processed in 97us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427754.953964:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789427754.954008:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343f956d80 x1876350877064704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427754.954026:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877064704:0@lo:13: 00000100:00080000:3.0:1789427754.954209:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789427755.209513:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427755.577076:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427755.577255:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857119872 00000100:00100000:0.0:1789427755.577266:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857119872 00000100:00100000:0.0:1789427755.577346:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:0.0:1789427755.577357:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:0:x1876350857119872:12345-192.168.201.55@tcp:41: 00000004:00000024:0.0:1789427755.577427:0:5836:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789427755.577505:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:0:x1876350857119872:12345-192.168.201.55@tcp:41: Request processed in 149us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.577527:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00080000:3.0:1789427755.577947:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427755.578017:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427755.578087:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857120000 00000100:00100000:3.0:1789427755.578094:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857120000 00000100:00100000:3.0:1789427755.578145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:3.0:1789427755.578155:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:5581:x1876350857120000:12345-192.168.201.55@tcp:41: 00000004:00000024:3.0:1789427755.578219:0:5835:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789427755.578273:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:5581:x1876350857120000:12345-192.168.201.55@tcp:41: Request processed in 119us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.578297:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:0.0:1789427755.589295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427755.589448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857120128 00000100:00100000:1.0:1789427755.589470:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857120128 00000100:00100000:1.0:1789427755.589580:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:1.0:1789427755.589592:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:5581:x1876350857120128:12345-192.168.201.55@tcp:40: 00000100:00100000:1.0:1789427755.589693:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:5581:x1876350857120128:12345-192.168.201.55@tcp:40: Request processed in 103us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427755.589700:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:2.0:1789427755.598311:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427755.598349:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427755.598398:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427755.598435:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427755.598611:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857120512 00000100:00100000:3.0:1789427755.598625:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857120512 00000100:00100000:3.0:1789427755.598689:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:3.0:1789427755.598700:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:5581:x1876350857120512:12345-192.168.201.55@tcp:33: 00000100:00100000:0.0:1789427755.599571:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857120256 00000100:00100000:0.0:1789427755.599587:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857120256 00000100:00100000:0.0:1789427755.599640:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857120384 00000100:00100000:0.0:1789427755.599644:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857120384 00000100:00100000:0.0:1789427755.599668:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:0.0:1789427755.599678:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876350857120256:12345-192.168.201.55@tcp:8: 00000100:00100000:3.0:1789427755.600037:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857120640 00000100:00100000:3.0:1789427755.600049:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857120640 00000100:00100000:3.0:1789427755.600245:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 127 00000100:00100000:3.0:1789427755.600254:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2354:x1876350857120640:12345-192.168.201.55@tcp:400: 00000100:00100000:3.0:1789427755.600330:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2354:x1876350857120640:12345-192.168.201.55@tcp:400: Request processed in 75us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.600338:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 127 00010000:00080000:0.0:1789427755.600354:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1789427755.600413:0:6684:0:(genops.c:1384:class_connect()) connect: client 691432fe-93d9-4afe-b1ac-013e2024784c, cookie 0x2bea1a57ca3432ea 00002000:00100000:0.0:1789427755.600431:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 691432fe-93d9-4afe-b1ac-013e2024784c/ffff93343faab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789427755.600447:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789427755.601400:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789427755.601455:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93343faa8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789427755.604355:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2353:x1876350857120256:12345-192.168.201.55@tcp:8: Request processed in 4653us (6033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.604383:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:0.0:1789427755.604449:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:0.0:1789427755.604459:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876350857120384:12345-192.168.201.55@tcp:8: 00010000:00080000:0.0:1789427755.604512:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1789427755.604580:0:6684:0:(genops.c:1384:class_connect()) connect: client 691432fe-93d9-4afe-b1ac-013e2024784c, cookie 0x2bea1a57ca3432f1 00002000:00100000:0.0:1789427755.604600:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 691432fe-93d9-4afe-b1ac-013e2024784c/ffff93343faaa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789427755.604639:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789427755.607235:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789427755.607307:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93343faad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789427755.607422:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2353:x1876350857120384:12345-192.168.201.55@tcp:8: Request processed in 2960us (9069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.607435:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 9 00000004:00080000:0.0:1789427755.625019:0:5837:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26243us 00000004:00200000:0.0:1789427755.652084:0:5837:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789427755.652250:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:5581:x1876350857120512:12345-192.168.201.55@tcp:33: Request processed in 53545us (53845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.652265:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:1.0:1789427755.968033:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427755.968227:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857120768 00000100:00100000:0.0:1789427755.968238:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857120768 00000100:00100000:0.0:1789427755.968305:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:0.0:1789427755.968317:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:5623:x1876350857120768:12345-192.168.201.55@tcp:101: 00010000:00010000:0.0:1789427755.968339:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427755.971429:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3432f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8646 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.971529:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3432ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.971544:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3432ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.971561:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3432ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427755.972906:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789427755.972916:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427755.972963:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3432ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.973004:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3432f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8646 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.973026:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3432ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8646 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427755.973035:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083ca500) 00010000:00010000:0.0:1789427755.973038:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427755.973042:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030000, rc 0) 00000100:00100000:0.0:1789427755.973241:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:5623:x1876350857120768:12345-192.168.201.55@tcp:101: Request processed in 4925us (5216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427755.973251:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:1.0:1789427755.977823:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877064832:0@lo:13: 00000100:00100000:1.0:1789427755.977895:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427755.978051:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877064832 00000100:00100000:2.0:1789427755.978061:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877064832 00000100:00100000:2.0:1789427755.978129:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789427755.978139:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877064832:12345-0@lo:13: 00002000:00000024:2.0:1789427755.978160:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427755.978225:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877064832:12345-0@lo:13: Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.978232:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789427755.978273:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343f957100 x1876350877064832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427755.978284:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789427755.978303:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877064832:0@lo:13: 00000100:00100000:3.0:1789427755.978501:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877064960:0@lo:400: 00000100:00100000:3.0:1789427755.978535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427755.978559:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877065472:0@lo:400: 00000100:00100000:3.0:1789427755.978581:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427755.978610:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427755.978615:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877065344:0@lo:400: 00000100:00100000:3.0:1789427755.978636:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427755.978658:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877064960 00000100:00100000:3.0:1789427755.978661:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877064960 00000100:00100000:3.0:1789427755.978684:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789427755.978689:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877064960:12345-0@lo:400: 00000100:00100000:3.0:1789427755.978718:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877064960:12345-0@lo:400: Request processed in 29us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.978734:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789427755.978757:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877065472 00000100:00100000:3.0:1789427755.978760:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877065472 00000100:00100000:3.0:1789427755.978784:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789427755.978790:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877065472:12345-0@lo:400: 00000100:00100000:3.0:1789427755.978827:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877065472:12345-0@lo:400: Request processed in 37us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.978832:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789427755.978850:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877065216:0@lo:400: 00000100:00100000:3.0:1789427755.978870:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427755.978886:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427755.978890:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877065088:0@lo:400: 00000100:00100000:3.0:1789427755.978905:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427755.978920:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877065216 00000100:00100000:3.0:1789427755.978923:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877065216 00000100:00100000:3.0:1789427755.978936:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877065088 00000100:00100000:3.0:1789427755.978938:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877065088 00000100:00100000:3.0:1789427755.978948:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789427755.978953:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877065216:12345-0@lo:400: 00000100:00100000:3.0:1789427755.978978:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877065216:12345-0@lo:400: Request processed in 25us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.978983:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789427755.978992:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789427755.978996:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877065088:12345-0@lo:400: 00000100:00100000:3.0:1789427755.979015:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877065088:12345-0@lo:400: Request processed in 19us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427755.979029:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789427755.979053:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877065088:0@lo:400: 00000100:00100000:3.0:1789427755.979061:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877065216:0@lo:400: 00000100:00100000:3.0:1789427755.979079:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877064960:0@lo:400: 00000100:00100000:3.0:1789427755.979087:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877065472:0@lo:400: 00000100:00080000:1.0:1789427755.979349:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789427755.979355:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427755.979449:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877065344 00000100:00100000:2.0:1789427755.979453:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877065344 00000100:00100000:2.0:1789427755.979489:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789427755.979496:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877065344:12345-0@lo:400: 00000100:00100000:2.0:1789427755.979537:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877065344:12345-0@lo:400: Request processed in 41us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427755.979550:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789427755.979578:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343fac0700 x1876350877065344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427755.979589:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877065344:0@lo:400: 00000001:00100000:0.0:1789427756.038726:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00010000:00010000:2.0:1789427756.236806:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427757.257387:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427757.976430:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427757.976517:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857120896 00000100:00100000:3.0:1789427757.976528:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857120896 00000100:00100000:3.0:1789427757.976615:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:3.0:1789427757.976628:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:5675:x1876350857120896:12345-192.168.201.55@tcp:41: 00000004:00000024:3.0:1789427757.976675:0:5835:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789427757.976836:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:5675:x1876350857120896:12345-192.168.201.55@tcp:41: Request processed in 210us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427757.976844:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00080000:1.0:1789427757.978499:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427757.991815:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427757.992023:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857121024 00000100:00100000:2.0:1789427757.992035:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857121024 00000100:00100000:2.0:1789427757.992117:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:2.0:1789427757.992128:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:691432fe-93d9-4afe-b1ac-013e2024784c+5:5675:x1876350857121024:12345-192.168.201.55@tcp:13: 00002000:00000024:2.0:1789427757.992168:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427757.992269:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:691432fe-93d9-4afe-b1ac-013e2024784c+5:5675:x1876350857121024:12345-192.168.201.55@tcp:13: Request processed in 142us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427757.992277:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00080000:1.0:1789427757.992641:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427758.000050:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427758.000683:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857121152 00000100:00100000:3.0:1789427758.000695:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857121152 00000100:00100000:3.0:1789427758.000789:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:3.0:1789427758.000801:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:691432fe-93d9-4afe-b1ac-013e2024784c+6:5675:x1876350857121152:12345-192.168.201.55@tcp:13: 00000100:00080000:1.0:1789427758.000804:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789427758.000852:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427758.000924:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:691432fe-93d9-4afe-b1ac-013e2024784c+6:5675:x1876350857121152:12345-192.168.201.55@tcp:13: Request processed in 125us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427758.000932:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00010000:00010000:0.0:1789427758.284641:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427759.305468:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789427759.594644:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000100:00100000:3.0:1789427760.075515:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427760.075560:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877065600:0@lo:13: 00000100:00100000:3.0:1789427760.075649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427760.075721:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877065600 00000100:00100000:3.0:1789427760.075731:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877065600 00000100:00100000:3.0:1789427760.075797:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427760.075807:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877065600:12345-0@lo:13: 00002000:00000024:3.0:1789427760.075851:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427760.075901:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877065600:12345-0@lo:13: Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427760.075908:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789427760.075930:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789427760.076212:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343fac1c00 x1876350877065600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427760.076238:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877065600:0@lo:13: 00000001:00100000:3.0:1789427760.180236:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00010000:00010000:2.0:1789427760.329506:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789427760.535614:0:8292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789427760.605659:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427760.605713:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427760.605752:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427760.605861:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857121536 00000100:00100000:1.0:1789427760.605874:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857121536 00000100:00100000:1.0:1789427760.605952:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:1.0:1789427760.605964:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857121536:12345-192.168.201.55@tcp:400: 00000100:00100000:1.0:1789427760.606056:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857121536:12345-192.168.201.55@tcp:400: Request processed in 95us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427760.606064:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:0.0:1789427760.606273:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857121280 00000100:00100000:0.0:1789427760.606295:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857121280 00000100:00100000:0.0:1789427760.606339:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 129 00000100:00100000:0.0:1789427760.606347:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2355:x1876350857121280:12345-192.168.201.55@tcp:400: 00000100:00100000:3.0:1789427760.606355:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427760.606381:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857121408 00000100:00100000:3.0:1789427760.606385:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857121408 00000100:00100000:0.0:1789427760.606385:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2355:x1876350857121280:12345-192.168.201.55@tcp:400: Request processed in 39us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427760.606391:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 129 00000100:00100000:3.0:1789427760.606420:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:3.0:1789427760.606427:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857121408:12345-192.168.201.55@tcp:400: 00000100:00100000:3.0:1789427760.606459:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857121408:12345-192.168.201.55@tcp:400: Request processed in 33us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427760.606465:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00080000:3.0:1789427760.606484:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789427760.606494:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427760.606505:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857121664 00000100:00100000:3.0:1789427760.606509:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857121664 00000100:00080000:0.0:1789427760.607960:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427760.608388:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:3.0:1789427760.608403:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857121664:12345-192.168.201.55@tcp:400: 00000100:00100000:3.0:1789427760.608495:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857121664:12345-192.168.201.55@tcp:400: Request processed in 97us (2713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427760.608503:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:3.0:1789427761.097557:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877065856:0@lo:400: 00000100:00100000:3.0:1789427761.097666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427761.097738:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877066368:0@lo:400: 00000100:00100000:3.0:1789427761.097773:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427761.097810:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427761.097815:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877065984:0@lo:400: 00000100:00100000:3.0:1789427761.097838:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427761.097876:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877065856 00000100:00100000:3.0:1789427761.097885:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877065856 00000100:00100000:3.0:1789427761.097939:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877065984 00000100:00100000:3.0:1789427761.097942:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877065984 00000100:00100000:3.0:1789427761.097971:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789427761.097981:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877065856:12345-0@lo:400: 00000100:00100000:3.0:1789427761.098043:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877065856:12345-0@lo:400: Request processed in 62us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427761.098052:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789427761.098079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427761.098086:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877065984:12345-0@lo:400: 00000100:00100000:3.0:1789427761.098126:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877065984:12345-0@lo:400: Request processed in 39us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427761.098144:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789427761.098167:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427761.098248:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877065728:0@lo:400: 00000100:00100000:1.0:1789427761.098298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427761.098337:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877066240:0@lo:400: 00000100:00100000:1.0:1789427761.098363:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427761.098387:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427761.098393:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877066112:0@lo:400: 00000100:00100000:1.0:1789427761.098422:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427761.098456:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877066368 00000100:00100000:1.0:1789427761.098460:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877066368 00000100:00100000:1.0:1789427761.098500:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877066112 00000100:00100000:1.0:1789427761.098502:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877066112 00000100:00100000:2.0:1789427761.098515:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877066496:0@lo:13: 00000100:00100000:1.0:1789427761.098520:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789427761.098528:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877066368:12345-0@lo:400: 00000100:00100000:2.0:1789427761.098560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427761.098571:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877066368:12345-0@lo:400: Request processed in 42us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.098580:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789427761.098599:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789427761.098605:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877066496 00000100:00100000:1.0:1789427761.098606:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877066112:12345-0@lo:400: 00000100:00100000:2.0:1789427761.098611:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877066496 00000100:00100000:1.0:1789427761.098650:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877066112:12345-0@lo:400: Request processed in 45us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.098658:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789427761.098662:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789427761.098673:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877066496:12345-0@lo:13: 00000100:00100000:1.0:1789427761.098681:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877065728 00000100:00100000:1.0:1789427761.098686:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877065728 00002000:00000024:2.0:1789427761.098708:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427761.098713:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789427761.098721:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877065728:12345-0@lo:400: 00000100:00100000:2.0:1789427761.098760:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877066496:12345-0@lo:13: Request processed in 88us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.098765:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877065728:12345-0@lo:400: Request processed in 43us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427761.098773:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789427761.098776:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1789427761.098813:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789427761.098845:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343fac3100 x1876350877066112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427761.098861:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877066112:0@lo:400: 00000100:00100000:1.0:1789427761.098871:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877065728:0@lo:400: 00000100:00100000:1.0:1789427761.098911:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877066240 00000100:00100000:1.0:1789427761.098914:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877066240 00000100:00100000:1.0:1789427761.098941:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789427761.098948:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877066240:12345-0@lo:400: 00000100:00100000:1.0:1789427761.098980:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877066240:12345-0@lo:400: Request processed in 33us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427761.098987:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789427761.098999:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427761.099017:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877066240:0@lo:400: 00010000:00080000:2.0:1789427761.099162:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343f957480 x1876350877066496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427761.099203:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877066496:0@lo:13: 00000100:00100000:2.0:1789427761.099253:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877065984:0@lo:400: 00000100:00100000:2.0:1789427761.099266:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877065856:0@lo:400: 00010000:00080000:2.0:1789427761.099290:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343fac1180 x1876350877066368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427761.099299:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877066368:0@lo:400: 00010000:00010000:1.0:1789427761.353968:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427762.377668:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427763.401696:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789427764.007231:0:8439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe58fc6fc0 20000000:00000080:0.0:1789427764.007265:0:8439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93343a8eec00 uarg=0000000000000000 20000000:01000000:0.0:1789427764.007317:0:8439:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789427764.007319:0:8439:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789427764.007323:0:8439:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789427764.007329:0:8439:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789427764.007336:0:8439:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789427764.008118:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789427764.008123:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789427764.008749:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789427764.008753:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789427764.012959:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789427764.018393:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789427764.018485:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789427764.018524:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1789427764.018543:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789427764.018546:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789427764.022076:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789427764.027619:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789427764.027683:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789427764.027744:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789427764.027758:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789427764.027762:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789427764.029856:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789427764.030624:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789427764.030676:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789427764.030712:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789427764.030725:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789427764.030727:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789427764.038924:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789427764.046078:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789427764.046409:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789427764.046447:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1789427764.046468:0:8439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789427764.046488:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046507:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3431fc expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046514:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343226 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046520:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343250 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046526:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34325e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046533:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34326c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046538:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343288 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046545:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3432b2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046554:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a85e4 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046561:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a85eb expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046578:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046619:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85eb expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046635:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85eb expref: 9 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.046650:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877066624:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427764.046925:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85e4 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046936:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85e4 expref: 9 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.046946:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877066752:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427764.046983:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3432b2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.046991:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3432b2 expref: 18 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.047001:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877066880:0@lo:104: 00000100:00100000:1.0:1789427764.047042:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427764.047245:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343288 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.047264:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343288 expref: 18 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.047272:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067008:0@lo:104: 00000100:00100000:1.0:1789427764.047299:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427764.050587:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34326c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.050605:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34326c expref: 18 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.050619:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067136:0@lo:104: 00010000:00010000:1.0:1789427764.050670:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34325e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.050679:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34325e expref: 18 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.050687:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067264:0@lo:104: 00010000:00010000:1.0:1789427764.050710:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343250 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.050718:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343250 expref: 18 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.050726:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067392:0@lo:104: 00010000:00010000:1.0:1789427764.050749:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343226 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.050774:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343226 expref: 18 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.050782:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067520:0@lo:104: 00010000:00010000:1.0:1789427764.050937:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3431fc expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.050946:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3431fc expref: 18 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.050954:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067648:0@lo:104: 00000100:00100000:1.0:1789427764.050979:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b48180 going to sleep for 11 seconds 00000100:00100000:2.0:1789427764.054883:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427764.054984:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427764.057343:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877066624:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427764.057362:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877066752:192.168.201.55@tcp:104: 00000100:00100000:2.0:1789427764.058273:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857121920 00000100:00100000:2.0:1789427764.058291:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857121920 00010000:00010000:2.0:1789427764.058352:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85e4 expref: 10 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.058399:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857121792 00000100:00100000:2.0:1789427764.058402:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857121792 00010000:00010000:2.0:1789427764.058432:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85eb expref: 11 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.058448:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:2.0:1789427764.058469:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:2356:x1876350857121920:12345-192.168.201.55@tcp:103: 00010000:00010000:2.0:1789427764.058493:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427764.058499:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85e4 expref: 11 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.058511:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85e4 expref: 11 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.058530:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02a000/0x2bea1a57ca3432c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85e4 expref: 11 pid: 5827 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.058548:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427764.058619:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2356:x1876350857121920:12345-192.168.201.55@tcp:103: Request processed in 152us (3751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.058626:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:2.0:1789427764.058645:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:2.0:1789427764.058651:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:2356:x1876350857121792:12345-192.168.201.55@tcp:103: 00010000:00010000:2.0:1789427764.058660:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427764.058664:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85eb expref: 9 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.058676:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85eb expref: 9 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.058687:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400031c00/0x2bea1a57ca3432ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a85eb expref: 9 pid: 5828 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.058703:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427764.058720:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:2356:x1876350857121792:12345-192.168.201.55@tcp:103: Request processed in 69us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.058726:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:0.0:1789427764.059450:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789427764.059503:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427764.059531:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427764.059543:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427764.059552:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427764.059563:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427764.059575:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877066880 00000100:00100000:0.0:1789427764.059583:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877066880 00000100:00100000:0.0:1789427764.059630:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877067008 00000100:00100000:0.0:1789427764.059632:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877067008 00000100:00100000:0.0:1789427764.059643:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877067136 00000100:00100000:0.0:1789427764.059645:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877067136 00000100:00100000:0.0:1789427764.059653:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877067264 00000100:00100000:0.0:1789427764.059656:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877067264 00000100:00100000:0.0:1789427764.059664:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877067392 00000100:00100000:0.0:1789427764.059678:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877067392 00000100:00100000:0.0:1789427764.059692:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877067520 00000100:00100000:0.0:1789427764.059694:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877067520 00000100:00100000:0.0:1789427764.059701:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877067648 00000100:00100000:0.0:1789427764.059703:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877067648 00000100:00100000:0.0:1789427764.059714:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789427764.059722:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:8439:x1876350877066880:12345-0@lo:104: 00010000:00010000:0.0:1789427764.059741:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.059940:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877066880:0@lo:104: 00010000:00010000:0.0:1789427764.060685:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427764.060696:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+9:8439:x1876350877066880:12345-0@lo:104: Request processed in 972us (13651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.060706:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789427764.060737:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789427764.060748:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+8:8439:x1876350877067008:12345-0@lo:104: 00010000:00010000:0.0:1789427764.060759:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427764.060894:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789427764.060900:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+8:8439:x1876350877067008:12345-0@lo:104: Request processed in 156us (13600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.060907:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789427764.060944:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789427764.060951:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+7:8439:x1876350877067136:12345-0@lo:104: 00010000:00010000:0.0:1789427764.060959:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427764.060995:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789427764.061010:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+7:8439:x1876350877067136:12345-0@lo:104: Request processed in 60us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.061015:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789427764.061029:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427764.061035:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+6:8439:x1876350877067264:12345-0@lo:104: 00010000:00010000:0.0:1789427764.061042:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.061209:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067008:0@lo:104: 00000100:00100000:1.0:1789427764.061229:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067136:0@lo:104: 00000100:00100000:1.0:1789427764.061236:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067264:0@lo:104: 00010000:00010000:1.0:1789427764.061442:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789427764.061450:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061457:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401527e00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427764.061461:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061480:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427764.061606:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427764.061612:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427764.061656:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061664:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427764.061683:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061690:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401527e00/0x2bea1a57ca3432b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3432b9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061706:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789427764.061709:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061715:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427764.061718:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061724:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427764.061731:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427764.061743:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427764.061757:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061763:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427764.061769:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061775:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca343288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34328f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061784:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789427764.061787:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061792:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031000 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427764.061795:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.061801:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427764.061807:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427764.061812:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789427764.061887:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427764.061895:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+6:8439:x1876350877067264:12345-0@lo:104: Request processed in 860us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.061902:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427764.061923:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427764.061931:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+5:8439:x1876350877067392:12345-0@lo:104: 00010000:00010000:0.0:1789427764.062105:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427764.062162:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789427764.062168:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+5:8439:x1876350877067392:12345-0@lo:104: Request processed in 239us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.062194:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427764.062210:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789427764.062226:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:8439:x1876350877067520:12345-0@lo:104: 00010000:00010000:0.0:1789427764.062235:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427764.062264:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789427764.062276:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:8439:x1876350877067520:12345-0@lo:104: Request processed in 61us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.062282:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789427764.062297:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789427764.062304:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:8439:x1876350877067648:12345-0@lo:104: 00010000:00010000:0.0:1789427764.062315:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427764.062357:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789427764.062364:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:8439:x1876350877067648:12345-0@lo:104: Request processed in 60us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427764.062371:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789427764.062395:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789427764.062410:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062423:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02ba00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789427764.062427:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062437:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427764.062445:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427764.062450:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427764.062502:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062508:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427764.062541:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062548:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca34325e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062582:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789427764.062585:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062591:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789427764.062594:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062602:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427764.062612:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427764.062618:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427764.062632:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062638:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427764.062644:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062650:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca343250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343257 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062660:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789427764.062663:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062680:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789427764.062683:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062689:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427764.062694:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427764.062700:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427764.062713:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062719:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427764.062723:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062728:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02a200/0x2bea1a57ca343226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34322d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062737:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427764.062740:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062745:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c7a00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789427764.062747:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.062763:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427764.062768:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427764.062773:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427764.062785:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.063053:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427764.063059:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.063066:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff9334421c7a00/0x2bea1a57ca3431fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343203 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.063076:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427764.063078:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427764.063080:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427764.063113:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877068288:0@lo:103: 00000100:00100000:2.0:1789427764.063598:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.063661:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427764.063669:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877068160:0@lo:103: 00000100:00100000:2.0:1789427764.063693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.063731:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877068288 00000100:00100000:2.0:1789427764.063740:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877068288 00010000:00010000:2.0:1789427764.063776:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343250 expref: 19 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.065133:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877068160 00000100:00100000:2.0:1789427764.065141:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877068160 00010000:00010000:2.0:1789427764.065190:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34325e expref: 20 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.065210:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789427764.065232:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+20:3301:x1876350877068288:12345-0@lo:103: 00010000:00010000:2.0:1789427764.065255:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427764.065263:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343250 expref: 20 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.065277:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343250 expref: 20 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.065302:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427764.065381:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+20:3301:x1876350877068288:12345-0@lo:103: Request processed in 151us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.065389:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789427764.065409:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789427764.065415:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877068160:12345-0@lo:103: 00010000:00010000:2.0:1789427764.065427:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427764.065431:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34325e expref: 19 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.065439:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34325e expref: 19 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.065449:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401527c00/0x2bea1a57ca343265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34325e expref: 19 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.065476:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427764.065500:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3301:x1876350877068160:12345-0@lo:103: Request processed in 85us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.065506:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789427764.065561:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877068160:0@lo:103: 00000100:00100000:2.0:1789427764.065572:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877068288:0@lo:103: 00000100:00100000:3.0:1789427764.066564:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1789427764.066596:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427764.067317:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877067776:0@lo:103: 00000100:00100000:2.0:1789427764.067393:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.067431:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877068416:0@lo:103: 00000100:00100000:2.0:1789427764.067449:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.067951:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789427764.067961:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877067904:0@lo:103: 00000100:00100000:2.0:1789427764.067996:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427764.068593:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877068544:0@lo:103: 00000100:00100000:2.0:1789427764.068627:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427764.068667:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427764.068683:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877067776 00000100:00100000:2.0:1789427764.068693:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877067776 00010000:00010000:2.0:1789427764.068736:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3432b2 expref: 18 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.068762:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877068416 00000100:00100000:2.0:1789427764.068766:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877068416 00010000:00010000:2.0:1789427764.068778:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343226 expref: 19 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.068935:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.068953:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789427764.069038:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877068032:0@lo:103: 00000100:00100000:0.0:1789427764.069123:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427764.069282:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.069292:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34326c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343273 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427764.069328:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427764.069331:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427764.069334:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427764.069374:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400031e00/0x2bea1a57ca343257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343250 expref: 19 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427764.069385:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067392:0@lo:104: 00000100:00100000:1.0:1789427764.069396:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067520:0@lo:104: 00000100:00100000:1.0:1789427764.069405:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876350877067648:0@lo:104: 00010000:00010000:1.0:1789427764.069445:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.070540:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877067904 00000100:00100000:2.0:1789427764.070549:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877067904 00010000:00010000:2.0:1789427764.070584:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343288 expref: 19 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.070597:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877068544 00000100:00100000:2.0:1789427764.070600:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877068544 00010000:00010000:2.0:1789427764.070616:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3431fc expref: 20 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.070627:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877068032 00000100:00100000:2.0:1789427764.070630:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877068032 00010000:00010000:2.0:1789427764.070644:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34326c expref: 21 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.070666:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789427764.070677:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+21:3298:x1876350877067776:12345-0@lo:103: 00010000:00010000:2.0:1789427764.070696:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427764.070703:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3432b2 expref: 21 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.070716:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3432b2 expref: 21 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.070734:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401526200/0x2bea1a57ca3432b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3432b2 expref: 21 pid: 5827 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.070751:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427764.071700:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+20:3298:x1876350877067776:12345-0@lo:103: Request processed in 967us (4249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.071732:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789427764.071762:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789427764.071771:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877068416:12345-0@lo:103: 00010000:00010000:2.0:1789427764.071786:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427764.071910:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343226 expref: 19 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.071924:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343226 expref: 19 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.071938:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400030e00/0x2bea1a57ca34322d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343226 expref: 19 pid: 5828 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.071949:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427764.071986:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3298:x1876350877068416:12345-0@lo:103: Request processed in 217us (4535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.071992:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789427764.072423:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789427764.072433:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e63050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:3298:x1876350877067904:12345-0@lo:103: 00010000:00010000:2.0:1789427764.072444:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427764.072450:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343288 expref: 17 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072478:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343288 expref: 17 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072489:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401527600/0x2bea1a57ca34328f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343288 expref: 17 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072512:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427764.072541:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e63050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3298:x1876350877067904:12345-0@lo:103: Request processed in 110us (4544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.072548:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789427764.072596:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789427764.072603:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:3298:x1876350877068544:12345-0@lo:103: 00010000:00010000:2.0:1789427764.072610:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427764.072614:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3431fc expref: 15 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072622:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3431fc expref: 15 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072631:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7200/0x2bea1a57ca343203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3431fc expref: 15 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072640:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427764.072661:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f956680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3298:x1876350877068544:12345-0@lo:103: Request processed in 59us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427764.072666:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789427764.072679:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789427764.072685:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:3300:x1876350877068032:12345-0@lo:103: 00010000:00010000:2.0:1789427764.072694:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427764.072698:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34326c expref: 13 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072706:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34326c expref: 13 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072722:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400030800/0x2bea1a57ca343273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34326c expref: 13 pid: 5829 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072734:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072743:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072762:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072771:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072778:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072785:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072791:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c7c00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789427764.072796:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072806:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.072993:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427764.073016:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427764.073047:0:8439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.073064:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:3300:x1876350877068032:12345-0@lo:103: Request processed in 376us (3938us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427764.073069:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427764.073076:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1789427764.073098:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343306 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427764.073264:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877068032:0@lo:103: 00000100:00100000:0.0:1789427764.081509:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877067776:0@lo:103: 00000100:00100000:0.0:1789427764.081527:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877068416:0@lo:103: 00000100:00100000:0.0:1789427764.081551:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877067904:0@lo:103: 00000100:00100000:0.0:1789427764.081676:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877068544:0@lo:103: 00010000:00010000:2.0:1789427764.426378:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427765.146566:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427765.146749:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857122048 00000100:00100000:1.0:1789427765.146817:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857122048 00000100:00100000:1.0:1789427765.146880:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 131 00000100:00100000:1.0:1789427765.146892:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:5595:x1876350857122048:12345-192.168.201.55@tcp:101: 00010000:00010000:1.0:1789427765.146926:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427765.146949:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7600/0x2bea1a57ca34330d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a864d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.146979:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7600/0x2bea1a57ca34330d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a864d expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.146990:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7600/0x2bea1a57ca34330d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a864d expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.147000:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7600, rc 0) 00000100:00100000:1.0:1789427765.147110:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5595:x1876350857122048:12345-192.168.201.55@tcp:101: Request processed in 219us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.147117:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 131 00000100:00100000:3.0:1789427765.150041:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427765.150430:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857122176 00000100:00100000:1.0:1789427765.150442:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857122176 00000100:00100000:1.0:1789427765.150537:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 132 00000100:00100000:1.0:1789427765.150549:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5595:x1876350857122176:12345-192.168.201.55@tcp:501: 00000100:00100000:1.0:1789427765.153127:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5595:x1876350857122176:12345-192.168.201.55@tcp:501: Request processed in 2568us (3083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.153140:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 132 00000100:00100000:2.0:1789427765.156603:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427765.156703:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857122304 00000100:00100000:1.0:1789427765.156714:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857122304 00000100:00100000:1.0:1789427765.156770:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 133 00000100:00100000:1.0:1789427765.156782:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5595:x1876350857122304:12345-192.168.201.55@tcp:503: 00000100:00100000:1.0:1789427765.157041:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5595:x1876350857122304:12345-192.168.201.55@tcp:503: Request processed in 259us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.157057:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 133 00000100:00100000:2.0:1789427765.160631:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427765.160692:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857122432 00000100:00100000:1.0:1789427765.160701:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857122432 00000100:00100000:1.0:1789427765.160752:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 134 00000100:00100000:1.0:1789427765.160763:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:6063:x1876350857122432:12345-192.168.201.55@tcp:502: 00000100:00100000:1.0:1789427765.161079:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:6063:x1876350857122432:12345-192.168.201.55@tcp:502: Request processed in 318us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.161088:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 134 00000100:00100000:0.0:1789427765.168820:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427765.168907:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857122560 00000100:00100000:3.0:1789427765.168920:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857122560 00000100:00100000:3.0:1789427765.168991:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 135 00000100:00100000:3.0:1789427765.169002:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:6063:x1876350857122560:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789427765.169426:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:6063:x1876350857122560:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 425us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.169446:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 135 00000100:00100000:2.0:1789427765.172652:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427765.173624:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857122688 00000100:00100000:1.0:1789427765.173638:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857122688 00000100:00100000:1.0:1789427765.173792:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 136 00000100:00100000:1.0:1789427765.173802:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5595:x1876350857122688:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427765.173819:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427765.173838:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7400/0x2bea1a57ca343314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8654 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.173866:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7400/0x2bea1a57ca343314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8654 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.173878:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7400/0x2bea1a57ca343314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8654 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.173887:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7400, rc 0) 00000100:00100000:1.0:1789427765.173958:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5595:x1876350857122688:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 Request processed in 157us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.173965:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 136 00000100:00100000:2.0:1789427765.175429:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427765.175504:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857122816 00000100:00100000:3.0:1789427765.175513:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857122816 00000100:00100000:3.0:1789427765.175557:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 137 00000100:00100000:3.0:1789427765.175567:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5595:x1876350857122816:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427765.175817:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5595:x1876350857122816:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 Request processed in 251us (392us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789427765.175826:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 137 00000100:00100000:0.0:1789427765.193559:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427765.193599:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877068672:0@lo:13: 00000100:00100000:0.0:1789427765.193691:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.193819:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877068672 00000100:00100000:2.0:1789427765.193831:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877068672 00000100:00100000:2.0:1789427765.193899:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789427765.193911:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877068672:12345-0@lo:13: 00002000:00000024:2.0:1789427765.193976:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427765.194074:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877068672:12345-0@lo:13: Request processed in 166us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427765.194084:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789427765.194139:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343f957480 x1876350877068672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427765.194160:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877068672:0@lo:13: 00000100:00080000:1.0:1789427765.194370:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789427765.449380:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789427765.641859:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789427765.641867:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93341d0db000 from 39 10000000:01000000:2.0:1789427765.641873:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789427765.641923:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.641953:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.641966:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427765.641990:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877068800:0@lo:101: 00000100:00100000:2.0:1789427765.642059:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.642123:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.642131:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877068800 00000100:00100000:1.0:1789427765.642141:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877068800 00000100:00100000:3.0:1789427765.642229:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789427765.642242:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+12:5831:x1876350877068800:12345-0@lo:101: 00010000:00010000:3.0:1789427765.642257:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427765.642278:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401527a00/0x2bea1a57ca343322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34331b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427765.642304:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401527a00/0x2bea1a57ca343322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34331b expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427765.642329:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401527a00/0x2bea1a57ca343322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34331b expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427765.642339:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527a00, rc 0) 00000100:00100000:3.0:1789427765.642389:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877068800:12345-0@lo:101: Request processed in 150us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.642396:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789427765.642724:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877068800:0@lo:101: 00010000:00010000:2.0:1789427765.642738:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.642748:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427765.642794:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877068928:0@lo:501: 00000100:00100000:2.0:1789427765.642818:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.642848:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.642901:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877068928 00000100:00100000:1.0:1789427765.642906:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877068928 00000100:00100000:1.0:1789427765.642943:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789427765.642950:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877068928:12345-0@lo:501: 00000100:00100000:1.0:1789427765.643216:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877068928:12345-0@lo:501: Request processed in 265us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.643224:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789427765.643234:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877068928:0@lo:501: 00000100:00100000:2.0:1789427765.643267:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877069056:0@lo:503: 00000100:00100000:2.0:1789427765.643305:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.643341:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427765.643843:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877069056 00000100:00100000:0.0:1789427765.643849:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877069056 00000100:00100000:0.0:1789427765.643883:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789427765.643890:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877069056:12345-0@lo:503: 00000100:00100000:0.0:1789427765.644054:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877069056:12345-0@lo:503: Request processed in 164us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427765.644061:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789427765.644258:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877069056:0@lo:503: 00000100:00100000:0.0:1789427765.646051:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8459:1876350877069184:0@lo:502: 00000100:00100000:0.0:1789427765.646109:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.646150:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.646204:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877069184 00000100:00100000:1.0:1789427765.646295:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877069184 00000100:00100000:1.0:1789427765.646344:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789427765.646358:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:8459:x1876350877069184:12345-0@lo:502: 00000100:00100000:1.0:1789427765.647421:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:8459:x1876350877069184:12345-0@lo:502: Request processed in 1062us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.647428:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789427765.648709:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8459:1876350877069184:0@lo:502: 00000100:00100000:0.0:1789427765.648783:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8459:1876350877069312:0@lo:502: 00000100:00100000:0.0:1789427765.648893:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.648997:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427765.649049:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877069312 00000100:00100000:3.0:1789427765.649057:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877069312 00000100:00100000:3.0:1789427765.649154:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789427765.649165:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:8459:x1876350877069312:12345-0@lo:502: 00000100:00100000:3.0:1789427765.649456:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:8459:x1876350877069312:12345-0@lo:502: Request processed in 292us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.649464:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789427765.649583:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8459:1876350877069312:0@lo:502: 00000040:00080000:0.0:1789427765.649604:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789427765.649824:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789427765.649849:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789427765.649859:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.649870:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427765.649880:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789427765.649883:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789427765.649886:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789427765.649912:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.649920:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.649929:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427765.649943:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877069440:0@lo:101: 00000100:00100000:2.0:1789427765.649975:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.650007:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.650025:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877069440 00000100:00100000:1.0:1789427765.650032:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877069440 00000100:00100000:1.0:1789427765.650078:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789427765.650087:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+13:5831:x1876350877069440:12345-0@lo:101: 00010000:00010000:1.0:1789427765.650098:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427765.650111:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343329 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.650132:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343329 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.650140:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343329 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.650151:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7c00, rc 0) 00000100:00100000:1.0:1789427765.650212:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877069440:12345-0@lo:101: Request processed in 126us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.650219:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789427765.650232:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877069440:0@lo:101: 00010000:00010000:2.0:1789427765.650249:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.650259:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427765.650299:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877069568:0@lo:501: 00000100:00100000:2.0:1789427765.650330:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.650355:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d059c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427765.650420:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877069568 00000100:00100000:3.0:1789427765.650426:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877069568 00000100:00100000:3.0:1789427765.650468:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789427765.650476:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877069568:12345-0@lo:501: 00000100:00100000:3.0:1789427765.650690:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877069568:12345-0@lo:501: Request processed in 214us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.650707:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789427765.650719:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877069568:0@lo:501: 00000100:00100000:2.0:1789427765.650749:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877069696:0@lo:503: 00000100:00100000:2.0:1789427765.650785:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.650804:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.650825:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877069696 00000100:00100000:1.0:1789427765.650829:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877069696 00000100:00100000:1.0:1789427765.650848:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789427765.650854:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877069696:12345-0@lo:503: 00000100:00100000:1.0:1789427765.650959:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877069696:12345-0@lo:503: Request processed in 104us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.650965:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789427765.650972:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877069696:0@lo:503: 00000100:00100000:2.0:1789427765.651256:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8460:1876350877069824:0@lo:502: 00000100:00100000:2.0:1789427765.651282:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.651299:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427765.651324:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877069824 00000100:00100000:3.0:1789427765.651330:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877069824 00000100:00100000:3.0:1789427765.651362:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789427765.651370:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:8460:x1876350877069824:12345-0@lo:502: 00000100:00100000:3.0:1789427765.651575:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:8460:x1876350877069824:12345-0@lo:502: Request processed in 205us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.651581:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789427765.651704:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8460:1876350877069824:0@lo:502: 00000020:01000000:2.0:1789427765.651721:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427765.651728:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427765.651731:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789427765.651736:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789427765.651756:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8460:1876350877069952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427765.651785:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.651805:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.651932:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877069952 00000100:00100000:1.0:1789427765.651937:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877069952 00000100:00100000:1.0:1789427765.651958:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789427765.651962:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:8460:x1876350877069952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427765.652056:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:8460:x1876350877069952:12345-0@lo:502:llog_process_th.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.652063:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789427765.652206:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8460:1876350877069952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789427765.652226:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789427765.652230:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427765.652230:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789427765.652233:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789427765.652696:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789427765.652711:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789427765.652721:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.652744:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427765.652754:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789427765.652756:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933406156800 from 39 10000000:01000000:0.0:1789427765.652759:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789427765.652783:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.652791:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.652809:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427765.652824:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.652867:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.652898:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427765.653236:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877070080 00000100:00100000:3.0:1789427765.653243:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877070080 00000100:00100000:3.0:1789427765.653279:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789427765.653287:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:5831:x1876350877070080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427765.653296:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427765.653307:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401526800/0x2bea1a57ca34333e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343337 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427765.653326:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401526800/0x2bea1a57ca34333e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343337 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427765.653336:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401526800/0x2bea1a57ca34333e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343337 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427765.653344:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401526800, rc 0) 00000100:00100000:3.0:1789427765.653386:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877070080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.653393:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789427765.653796:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427765.653807:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.653813:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427765.653860:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.653885:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.653912:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427765.653940:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877070208 00000100:00100000:2.0:1789427765.653946:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877070208 00000100:00100000:2.0:1789427765.653981:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789427765.653989:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877070208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427765.654297:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877070208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427765.654302:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789427765.654354:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.654388:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.654430:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.654450:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427765.654501:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877070336 00000100:00100000:3.0:1789427765.654507:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877070336 00000100:00100000:3.0:1789427765.654540:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789427765.654546:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877070336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427765.654767:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877070336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427765.654773:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427765.654780:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789427765.655142:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8461:1876350877070464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427765.655222:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427765.655253:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411873900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427765.655282:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877070464 00000100:00100000:2.0:1789427765.655287:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877070464 00000100:00100000:2.0:1789427765.655319:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789427765.655326:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:8461:x1876350877070464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427765.655516:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:8461:x1876350877070464:12345-0@lo:502:llog_process_th.0 Request processed in 190us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427765.655523:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789427765.655849:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8461:1876350877070464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427765.655889:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8461:1876350877070592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427765.655922:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427765.655947:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff933403170a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.655994:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877070592 00000100:00100000:1.0:1789427765.655999:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877070592 00000100:00100000:1.0:1789427765.656034:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789427765.656041:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:8461:x1876350877070592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427765.656236:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:8461:x1876350877070592:12345-0@lo:502:llog_process_th.0 Request processed in 195us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.656243:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789427765.656358:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8461:1876350877070592:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789427765.656378:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789427765.656446:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789427765.656462:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427765.656480:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.656498:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427765.656508:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789427765.656510:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789427765.656513:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789427765.656533:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.656541:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.656549:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427765.656561:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.656588:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.656617:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789427765.656711:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877070720 00000100:00100000:2.0:1789427765.656717:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877070720 00000100:00100000:2.0:1789427765.656788:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789427765.656796:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:5831:x1876350877070720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427765.656805:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427765.656816:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02a200/0x2bea1a57ca34334c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343345 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.656835:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02a200/0x2bea1a57ca34334c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343345 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.656844:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02a200/0x2bea1a57ca34334c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343345 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.656853:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a200, rc 0) 00000100:00100000:2.0:1789427765.656886:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877070720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427765.656892:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789427765.656919:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427765.656933:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.656943:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427765.656984:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.657010:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.657040:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc240 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.657063:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877070848 00000100:00100000:1.0:1789427765.657068:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877070848 00000100:00100000:1.0:1789427765.657111:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789427765.657122:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877070848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427765.657413:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877070848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.657418:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789427765.657440:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.657469:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.657502:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.657598:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789427765.657925:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877070976 00000100:00100000:2.0:1789427765.657931:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877070976 00000100:00100000:2.0:1789427765.657963:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789427765.657971:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877070976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427765.658111:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877070976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427765.658118:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789427765.658142:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877070976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.659160:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8462:1876350877071104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427765.659247:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.659269:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.659331:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877071104 00000100:00100000:1.0:1789427765.659336:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877071104 00000100:00100000:1.0:1789427765.659370:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789427765.659378:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:8462:x1876350877071104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427765.659530:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:8462:x1876350877071104:12345-0@lo:502:llog_process_th.0 Request processed in 153us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.659537:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789427765.659613:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8462:1876350877071104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427765.659634:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427765.659642:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427765.659644:0:8462:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789427765.659649:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789427765.659666:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8462:1876350877071232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427765.659696:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.659714:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427765.659737:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877071232 00000100:00100000:2.0:1789427765.659742:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877071232 00000100:00100000:2.0:1789427765.659777:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789427765.659792:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:8462:x1876350877071232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427765.659916:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:8462:x1876350877071232:12345-0@lo:502:llog_process_th.0 Request processed in 131us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427765.659923:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789427765.659942:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8462:1876350877071232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427765.659962:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427765.659966:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427765.659968:0:8462:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789427765.659970:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789427765.660040:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789427765.660060:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789427765.660068:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.660079:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427765.660095:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789427765.660097:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933433d9c800 from 39 10000000:01000000:2.0:1789427765.660099:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789427765.660117:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.660123:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.660132:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427765.660161:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877071360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789427765.660221:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.660235:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05840 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.661025:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877071360 00000100:00100000:1.0:1789427765.661031:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877071360 00000100:00100000:1.0:1789427765.661064:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789427765.661072:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877071360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427765.661082:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427765.661094:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7200/0x2bea1a57ca34335a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343353 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.661114:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7200/0x2bea1a57ca34335a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343353 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.661124:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7200/0x2bea1a57ca34335a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343353 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427765.661144:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7200, rc 0) 00000100:00100000:1.0:1789427765.661214:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877071360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.661221:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789427765.661236:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877071360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427765.661253:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.661264:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427765.661309:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877071488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427765.661335:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.661365:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05840 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.661367:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877071488 00000100:00100000:1.0:1789427765.661375:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877071488 00000100:00100000:1.0:1789427765.661415:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789427765.661422:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877071488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427765.661631:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877071488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.661639:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789427765.661660:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877071488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427765.661749:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877071616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427765.661784:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.661802:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05840 going to sleep for 11 seconds 00000100:00100000:3.0:1789427765.661826:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877071616 00000100:00100000:3.0:1789427765.661840:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877071616 00000100:00100000:3.0:1789427765.661874:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789427765.661881:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877071616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427765.662033:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877071616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.662040:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789427765.662107:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877071616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427765.662468:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8463:1876350877071744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427765.662500:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.662531:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340822f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.662545:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877071744 00000100:00100000:1.0:1789427765.662551:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877071744 00000100:00100000:1.0:1789427765.662580:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789427765.662586:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:8463:x1876350877071744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427765.662764:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:8463:x1876350877071744:12345-0@lo:502:llog_process_th.0 Request processed in 177us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.662771:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789427765.662790:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8463:1876350877071744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427765.662830:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8463:1876350877071872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427765.662873:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.662889:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05840 going to sleep for 11 seconds 00000100:00100000:0.0:1789427765.662901:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877071872 00000100:00100000:0.0:1789427765.662905:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877071872 00000100:00100000:0.0:1789427765.662936:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789427765.662942:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:8463:x1876350877071872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427765.663051:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:8463:x1876350877071872:12345-0@lo:502:llog_process_th.0 Request processed in 109us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427765.663058:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789427765.663093:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8463:1876350877071872:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789427765.663110:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789427765.663216:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789427765.663248:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427765.663256:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.663267:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427765.663282:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789427765.663285:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789427765.663287:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789427765.663308:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.663315:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.663323:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427765.663335:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.663361:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.663394:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877072000 00000100:00100000:2.0:1789427765.663400:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877072000 00000100:00100000:2.0:1789427765.663429:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789427765.663436:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877072000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427765.663445:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427765.663456:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02a600/0x2bea1a57ca343368 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343361 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.663474:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02a600/0x2bea1a57ca343368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343361 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.663484:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02a600/0x2bea1a57ca343368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343361 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427765.663492:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a600, rc 0) 00000100:00100000:2.0:1789427765.663516:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877072000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427765.663522:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789427765.663663:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427765.663678:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427765.663689:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.663704:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427765.663744:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.663769:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.663787:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427765.663807:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877072128 00000100:00100000:3.0:1789427765.663813:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877072128 00000100:00100000:3.0:1789427765.663849:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789427765.663858:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877072128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427765.664062:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877072128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.664076:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789427765.664096:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.664122:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.664154:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.664229:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427765.664267:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877072256 00000100:00100000:2.0:1789427765.664273:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877072256 00000100:00100000:2.0:1789427765.664300:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789427765.664308:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877072256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427765.664457:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877072256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427765.664472:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789427765.664525:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427765.664775:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8464:1876350877072384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427765.664810:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427765.664830:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff933406123cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427765.664853:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877072384 00000100:00100000:3.0:1789427765.664859:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877072384 00000100:00100000:3.0:1789427765.664886:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789427765.664893:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8464:x1876350877072384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427765.665033:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8464:x1876350877072384:12345-0@lo:502:llog_process_th.0 Request processed in 141us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.665038:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789427765.665066:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8464:1876350877072384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427765.665088:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427765.665096:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427765.665099:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789427765.665104:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789427765.665122:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8464:1876350877072512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427765.665164:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427765.665219:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877072512 00000100:00100000:1.0:1789427765.665223:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877072512 00000100:00100000:2.0:1789427765.665224:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c307540 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.665253:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789427765.665262:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8464:x1876350877072512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427765.665518:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8464:x1876350877072512:12345-0@lo:502:llog_process_th.0 Request processed in 257us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427765.665525:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789427765.665540:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8464:1876350877072512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427765.665558:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427765.665562:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427765.665563:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789427765.665566:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789427765.665618:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789427765.665635:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789427765.665642:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.665650:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427765.665655:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789427765.665657:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9334101b3380 from 1 10000000:01000000:0.0:1789427765.665659:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789427765.665674:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.665679:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.665691:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427765.665702:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.665736:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.665753:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427765.665768:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877072640 00000100:00100000:3.0:1789427765.665773:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877072640 00000100:00100000:3.0:1789427765.665797:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789427765.665805:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877072640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427765.665813:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427765.665823:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401526e00/0x2bea1a57ca343376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34336f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427765.665840:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401526e00/0x2bea1a57ca343376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34336f expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427765.665850:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401526e00/0x2bea1a57ca343376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34336f expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427765.665857:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401526e00, rc 0) 00000100:00100000:3.0:1789427765.665891:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877072640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.665904:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789427765.665926:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427765.665941:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343376 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.665950:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343376 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427765.665987:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427765.666013:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427765.666033:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427765.666055:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877072768 00000100:00100000:1.0:1789427765.666060:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877072768 00000100:00100000:1.0:1789427765.666087:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789427765.666095:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877072768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427765.666413:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877072768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (398us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427765.666422:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789427765.666428:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877072768:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789427765.666449:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789427765.666455:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343376 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427765.666463:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343376 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427765.722646:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427765.722698:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427765.722750:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427765.722775:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857123072 00000100:00100000:0.0:1789427765.722780:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857123200 00000100:00100000:2.0:1789427765.722786:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857123072 00000100:00100000:0.0:1789427765.722787:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857123200 00000100:00100000:2.0:1789427765.722856:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:2.0:1789427765.722866:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857123072:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427765.722896:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857122944 00000100:00100000:3.0:1789427765.722902:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857122944 00000100:00100000:0.0:1789427765.722928:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789427765.722936:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857123072:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427765.722939:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789427765.722948:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:3.0:1789427765.722953:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 26 00000100:00100000:3.0:1789427765.722964:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857122944:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427765.722972:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:2.0:1789427765.722982:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857123200:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427765.723005:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857122944:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427765.723013:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 26 00000100:00100000:2.0:1789427765.723032:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857123200:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 49us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427765.723040:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00080000:2.0:1789427765.723066:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427765.723071:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427765.723073:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427766.224635:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877073024:0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.224781:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877072896:0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.224860:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427766.224911:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877073408:0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.224937:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427766.224974:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877073152:0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.224997:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427766.225029:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427766.225035:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877073280:0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.225058:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427766.225091:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877073408 00000100:00100000:2.0:1789427766.225101:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877073408 00000100:00100000:2.0:1789427766.225165:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877073152 00000100:00100000:2.0:1789427766.225169:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877073152 00000100:00100000:2.0:1789427766.225251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789427766.225262:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877073408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.225330:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877073408:12345-0@lo:400:kworker.0 Request processed in 69us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427766.225338:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789427766.225369:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789427766.225376:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877073152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.225427:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877073152:12345-0@lo:400:kworker.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427766.225433:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789427766.225454:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877073280 00000100:00100000:2.0:1789427766.225457:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877073280 00000100:00100000:2.0:1789427766.225484:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789427766.225490:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877073280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.225522:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877073280:12345-0@lo:400:kworker.0 Request processed in 33us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427766.225527:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789427766.225543:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789427766.225583:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d926300 x1876350877073280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427766.225599:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877073280:0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.225610:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877073152:0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.225638:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877073408:0@lo:400:kworker.0 00000100:00100000:0.0:1789427766.226105:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427766.226140:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877073536:0@lo:400:kworker.0 00000100:00100000:0.0:1789427766.226168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427766.227771:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877073024 00000100:00100000:2.0:1789427766.227790:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877073024 00000100:00100000:2.0:1789427766.227861:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789427766.227873:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877073024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427766.227979:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877073024:12345-0@lo:400:kworker.0 Request processed in 109us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427766.227987:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789427766.228888:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877072896 00000100:00100000:3.0:1789427766.228900:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877072896 00000100:00100000:3.0:1789427766.228945:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789427766.228954:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877072896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427766.229038:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877072896:12345-0@lo:400:kworker.0 Request processed in 84us (4178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427766.229044:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789427766.229086:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877073536 00000100:00100000:3.0:1789427766.229090:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877073536 00000100:00100000:3.0:1789427766.229139:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789427766.229145:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877073536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427766.229217:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877073536:12345-0@lo:400:kworker.0 Request processed in 72us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427766.229223:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789427766.229940:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877073024:0@lo:400:kworker.0 00010000:00080000:2.0:1789427766.229983:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d926d80 x1876350877073536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427766.229994:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877073536:0@lo:400:kworker.0 00000100:00080000:2.0:1789427766.230821:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427766.236262:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427766.236291:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877073664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427766.236389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427766.236483:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877072896:0@lo:400:kworker.0 00000100:00100000:1.0:1789427766.236536:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877073664 00000100:00100000:1.0:1789427766.236543:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877073664 00000100:00100000:1.0:1789427766.236600:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789427766.236610:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877073664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427766.236655:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427766.236723:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877073664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427766.236730:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789427766.236789:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411ba9880 x1876350877073664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427766.236808:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877073664:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1789427766.428260:0:8502:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdafdaf3f0 20000000:00000080:3.0:1789427766.428285:0:8502:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff933420e9cc00 uarg=0000000000000000 20000000:01000000:3.0:1789427766.428606:0:8502:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789427766.428614:0:8502:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789427766.428631:0:8502:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789427766.430875:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789427766.431078:0:8502:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789427766.435123:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789427766.436108:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789427766.436344:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789427766.436370:0:8502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789427766.436397:0:8502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.436420:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401491c00/0x2bea1a57ca3430f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3430eb expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.436429:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34314d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.436436:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343218 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.436447:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a861c expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.436456:0:8502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.436510:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a861c expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.436529:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a861c expref: 9 pid: 5829 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427766.436547:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876350877073792:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427766.436752:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343218 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.436774:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343218 expref: 18 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427766.436784:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876350877073920:0@lo:104: 00000100:00100000:3.0:1789427766.436844:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789427766.436890:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34314d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.436899:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34314d expref: 18 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427766.436907:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876350877074048:0@lo:104: 00000100:00100000:3.0:1789427766.436934:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427766.436980:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789427766.436996:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877073920 00000100:00100000:3.0:1789427766.437005:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877073920 00000100:00100000:3.0:1789427766.437054:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877074048 00000100:00100000:3.0:1789427766.437058:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877074048 00000100:00100000:3.0:1789427766.437075:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789427766.437085:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:8502:x1876350877073920:12345-0@lo:104: 00010000:00010000:3.0:1789427766.437099:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.437157:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789427766.437163:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:8502:x1876350877073920:12345-0@lo:104: Request processed in 80us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427766.437171:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789427766.437228:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789427766.437246:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:8502:x1876350877074048:12345-0@lo:104: 00010000:00010000:3.0:1789427766.437254:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.437292:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789427766.437297:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:8502:x1876350877074048:12345-0@lo:104: Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427766.437303:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789427766.437370:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401491c00/0x2bea1a57ca3430f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3430eb expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.437379:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933401491c00/0x2bea1a57ca3430f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3430eb expref: 18 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427766.437388:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876350877074176:0@lo:104: 00000100:00100000:3.0:1789427766.437413:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427766.437435:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877074176 00000100:00100000:3.0:1789427766.437439:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877074176 00000100:00100000:3.0:1789427766.437457:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789427766.437462:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:8502:x1876350877074176:12345-0@lo:104: 00010000:00010000:3.0:1789427766.437470:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.437520:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789427766.437526:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:8502:x1876350877074176:12345-0@lo:104: Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427766.437533:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789427766.437557:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340813e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427766.437588:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876350877073920:0@lo:104: 00000100:00100000:3.0:1789427766.437605:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876350877074048:0@lo:104: 00000100:00100000:3.0:1789427766.437610:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876350877074176:0@lo:104: 00010000:00010000:0.0:1789427766.437809:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789427766.437818:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.437828:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401527400 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427766.437832:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.437843:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427766.437852:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427766.437858:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427766.437902:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.437910:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427766.437936:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.437954:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401527400/0x2bea1a57ca343218 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca34321f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.437981:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789427766.437985:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.437992:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427766.437995:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438002:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427766.438008:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427766.438013:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427766.438029:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438036:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427766.438055:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438062:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca34314d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343154 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438073:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427766.438083:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438089:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401490a00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427766.438092:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438099:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427766.438104:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427766.438109:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427766.438123:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438128:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427766.438135:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438140:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401490a00/0x2bea1a57ca3430eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3430f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438155:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427766.438157:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427766.438159:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427766.438223:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877074304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427766.438266:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427766.438311:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877074304 00000100:00100000:0.0:1789427766.438317:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877074304 00010000:00010000:0.0:1789427766.438349:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343218 expref: 19 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427766.438375:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789427766.438383:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877074304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427766.438395:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427766.438400:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343218 expref: 19 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438409:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343218 expref: 19 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438423:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7000/0x2bea1a57ca34321f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343218 expref: 19 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438436:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427766.438469:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3301:x1876350877074304:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427766.438475:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789427766.438506:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877074304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427766.438541:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877074432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427766.438565:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427766.438586:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427766.438592:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877074560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427766.438611:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427766.438636:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877074432 00000100:00100000:0.0:1789427766.438640:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877074432 00010000:00010000:0.0:1789427766.438653:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34314d expref: 18 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427766.438673:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877074560 00000100:00100000:0.0:1789427766.438676:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877074560 00010000:00010000:0.0:1789427766.438689:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401491c00/0x2bea1a57ca3430f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3430eb expref: 19 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427766.438717:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789427766.438724:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877074432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427766.438732:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427766.438736:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34314d expref: 19 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438743:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34314d expref: 19 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438753:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401526600/0x2bea1a57ca343154 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34314d expref: 19 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.438762:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427766.438790:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3298:x1876350877074432:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427766.438796:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789427766.439350:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789427766.439361:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:3298:x1876350877074560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427766.439371:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427766.439376:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401491c00/0x2bea1a57ca3430f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3430eb expref: 17 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.439385:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401491c00/0x2bea1a57ca3430f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3430eb expref: 17 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.439406:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401491c00/0x2bea1a57ca3430f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3430eb expref: 17 pid: 5827 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.439419:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427766.439449:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3298:x1876350877074560:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427766.439455:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789427766.439487:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877074560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427766.439495:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877074432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427766.440238:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427766.440246:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427766.442632:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876350877073792:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427766.442680:0:8502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427766.450985:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427766.451290:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857123328 00000100:00100000:0.0:1789427766.451304:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857123328 00010000:00010000:0.0:1789427766.451369:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a861c expref: 10 pid: 5829 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427766.451414:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:0.0:1789427766.451426:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2356:x1876350857123328:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427766.451445:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427766.451452:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a861c expref: 10 pid: 5829 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451469:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a861c expref: 10 pid: 5829 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451498:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401527200/0x2bea1a57ca3432dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a861c expref: 10 pid: 5829 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451524:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451553:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451576:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451584:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451592:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451601:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451608:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401526200 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789427766.451614:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451623:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451652:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427766.451665:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427766.451752:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:2356:x1876350857123328:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 325us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427766.451762:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 24 00010000:00010000:1.0:1789427766.451784:0:8502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427766.451835:0:8502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427766.451843:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401526200/0x2bea1a57ca34337d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427766.475002:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427766.633877:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427766.635049:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857123456 00000100:00100000:1.0:1789427766.635066:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857123456 00000100:00100000:1.0:1789427766.635211:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 171 00000100:00100000:1.0:1789427766.635224:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:5595:x1876350857123456:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427766.635246:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427766.635271:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a865b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427766.635310:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a865b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427766.635324:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a865b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427766.635334:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7e00, rc 0) 00000100:00100000:1.0:1789427766.635428:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5595:x1876350857123456:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 Request processed in 206us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427766.635436:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 171 00000100:00100000:2.0:1789427766.644390:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427766.645007:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857123584 00000100:00100000:0.0:1789427766.645031:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857123584 00000100:00100000:0.0:1789427766.645095:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 172 00000100:00100000:0.0:1789427766.645107:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5595:x1876350857123584:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427766.646799:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5595:x1876350857123584:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 Request processed in 1681us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427766.648150:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 172 00000100:00100000:3.0:1789427766.649244:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427766.649669:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857123712 00000100:00100000:0.0:1789427766.649682:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857123712 00000100:00100000:0.0:1789427766.649742:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 173 00000100:00100000:0.0:1789427766.649755:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5595:x1876350857123712:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427766.651211:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:5595:x1876350857123712:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 Request processed in 1448us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427766.651226:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 173 00000100:00100000:0.0:1789427766.659190:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427766.659299:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857123840 00000100:00100000:2.0:1789427766.659313:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857123840 00000100:00100000:2.0:1789427766.659385:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 174 00000100:00100000:2.0:1789427766.659397:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:6105:x1876350857123840:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789427766.659856:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:6105:x1876350857123840:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 460us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427766.659866:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 174 00000100:00100000:2.0:1789427766.668724:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427766.668775:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857123968 00000100:00100000:2.0:1789427766.668788:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857123968 00000100:00100000:2.0:1789427766.668850:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 175 00000100:00100000:2.0:1789427766.668863:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:6105:x1876350857123968:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789427766.669229:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:6105:x1876350857123968:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 367us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427766.669238:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 175 00010000:00010000:0.0:1789427767.497459:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789427767.689314:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789427767.689324:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93341d0db000 from 4 10000000:01000000:3.0:1789427767.689346:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789427767.689409:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427767.689421:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427767.689430:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427767.689466:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877074688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.689573:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427767.689638:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427767.689647:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877074688 00000100:00100000:0.0:1789427767.689657:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877074688 00000100:00100000:0.0:1789427767.689732:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789427767.689744:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877074688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427767.689760:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427767.689776:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34338b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427767.689804:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34338b expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427767.689815:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34338b expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427767.689843:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178600, rc 0) 00000100:00100000:0.0:1789427767.689898:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877074688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427767.689905:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789427767.690035:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877074688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427767.690050:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427767.690059:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427767.690133:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877074816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.690192:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427767.690210:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427767.690240:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877074816 00000100:00100000:2.0:1789427767.690246:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877074816 00000100:00100000:2.0:1789427767.690283:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789427767.690291:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877074816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427767.690718:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877074816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 427us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427767.690724:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789427767.690759:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877074816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.690787:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877074944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.690831:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427767.690856:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427767.690886:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877074944 00000100:00100000:0.0:1789427767.690892:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877074944 00000100:00100000:0.0:1789427767.690925:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789427767.690932:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877074944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427767.691112:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877074944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427767.691119:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789427767.691162:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877074944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.691535:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8522:1876350877075072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427767.691563:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427767.691584:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427767.691611:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877075072 00000100:00100000:2.0:1789427767.691617:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877075072 00000100:00100000:2.0:1789427767.691647:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789427767.691654:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:8522:x1876350877075072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427767.691799:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:8522:x1876350877075072:12345-0@lo:502:llog_process_th.0 Request processed in 145us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427767.691807:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789427767.691843:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8522:1876350877075072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789427767.691870:0:8522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789427767.691881:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427767.691884:0:8522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789427767.691892:0:8522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93341d0db000 00000020:00000080:3.0:1789427767.691895:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789427767.691988:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8522:1876350877075200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427767.692020:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427767.692036:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427767.692064:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877075200 00000100:00100000:0.0:1789427767.692070:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877075200 00000100:00100000:0.0:1789427767.692105:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789427767.692114:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:8522:x1876350877075200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427767.692304:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:8522:x1876350877075200:12345-0@lo:502:llog_process_th.0 Request processed in 190us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427767.692312:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789427767.692352:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8522:1876350877075200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427767.692380:0:8522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427767.692387:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427767.692396:0:8522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789427767.692400:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789427767.692582:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789427767.692603:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789427767.692612:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427767.692625:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427767.692659:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789427767.692662:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933406156800 from 4 10000000:01000000:0.0:1789427767.692665:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789427767.692692:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427767.692700:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427767.692710:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427767.692724:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877075328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789427767.692760:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427767.692797:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427767.692914:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877075328 00000100:00100000:1.0:1789427767.692920:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877075328 00000100:00100000:1.0:1789427767.692970:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789427767.692980:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877075328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427767.692989:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427767.693004:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343399 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427767.693026:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343399 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427767.693038:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343399 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427767.693047:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7a00, rc 0) 00000100:00100000:1.0:1789427767.693094:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877075328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427767.693100:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789427767.693261:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877075328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427767.693273:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427767.693297:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427767.693344:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877075456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.693369:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427767.693384:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789427767.693422:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877075456 00000100:00100000:0.0:1789427767.693426:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877075456 00000100:00100000:0.0:1789427767.693453:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789427767.693458:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877075456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427767.693675:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877075456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427767.693682:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789427767.694064:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877075456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.694092:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877075584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.694126:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427767.694158:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789427767.694198:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877075584 00000100:00100000:1.0:1789427767.694204:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877075584 00000100:00100000:1.0:1789427767.694244:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789427767.694253:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877075584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427767.694449:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877075584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427767.694459:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789427767.694610:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877075584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427767.695102:0:8523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8523:1876350877075712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427767.695147:0:8523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427767.695202:0:8523:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbe780 going to sleep for 11 seconds 00000100:00100000:3.0:1789427767.696233:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877075712 00000100:00100000:3.0:1789427767.696242:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877075712 00000100:00100000:3.0:1789427767.696295:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789427767.696308:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8523:x1876350877075712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427767.696582:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8523:x1876350877075712:12345-0@lo:502:llog_process_th.0 Request processed in 276us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427767.696590:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789427767.696960:0:8523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8523:1876350877075712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427767.696998:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427767.697007:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427767.697009:0:8523:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789427767.697013:0:8523:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933406156800 00000020:00000080:0.0:1789427767.697018:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789427767.697120:0:8523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8523:1876350877075840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427767.697206:0:8523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427767.697238:0:8523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427767.697253:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877075840 00000100:00100000:0.0:1789427767.697259:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877075840 00000100:00100000:0.0:1789427767.697307:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789427767.697317:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8523:x1876350877075840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427767.697515:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:8523:x1876350877075840:12345-0@lo:502:llog_process_th.0 Request processed in 198us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427767.697522:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789427767.697564:0:8523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8523:1876350877075840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427767.697578:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427767.697581:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427767.697583:0:8523:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789427767.697585:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789427767.698225:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789427767.698250:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789427767.698280:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427767.698294:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427767.698312:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789427767.698315:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933433d9c800 from 4 10000000:01000000:3.0:1789427767.698318:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789427767.698357:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427767.698454:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427767.698464:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427767.698482:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877075968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.698518:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427767.698549:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789427767.698938:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877075968 00000100:00100000:2.0:1789427767.698945:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877075968 00000100:00100000:2.0:1789427767.698985:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789427767.698993:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877075968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427767.699003:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427767.699014:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3433a7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427767.699035:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3433a7 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427767.699045:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3433a7 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427767.699052:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02b000, rc 0) 00000100:00100000:2.0:1789427767.699083:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877075968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427767.699097:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789427767.699309:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877075968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427767.699321:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427767.699330:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427767.700285:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877076096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.700325:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427767.700426:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877076096 00000100:00100000:2.0:1789427767.700432:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877076096 00000100:00100000:2.0:1789427767.700473:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789427767.700481:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877076096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.700667:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789427767.700715:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877076096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427767.700723:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789427767.700821:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877076096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.700864:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877076224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427767.700902:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427767.700925:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789427767.701064:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877076224 00000100:00100000:2.0:1789427767.701069:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877076224 00000100:00100000:2.0:1789427767.701100:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789427767.701107:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877076224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427767.701430:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877076224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 324us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427767.701437:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789427767.702301:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877076224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427767.702764:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8526:1876350877076352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427767.702815:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427767.702852:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1789427767.702900:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877076352 00000100:00100000:1.0:1789427767.702907:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877076352 00000100:00100000:1.0:1789427767.702947:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789427767.702957:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:8526:x1876350877076352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427767.703124:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:8526:x1876350877076352:12345-0@lo:502:llog_process_th.0 Request processed in 169us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427767.703131:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789427767.703241:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8526:1876350877076352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427767.703265:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427767.703275:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427767.703277:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789427767.703283:0:8526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933433d9c800 00000020:00000080:0.0:1789427767.703286:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789427767.703364:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8526:1876350877076480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427767.703398:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427767.703420:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877076480 00000100:00100000:0.0:1789427767.703424:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877076480 00000100:00100000:0.0:1789427767.703448:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789427767.703453:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:8526:x1876350877076480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427767.703558:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:8526:x1876350877076480:12345-0@lo:502:llog_process_th.0 Request processed in 104us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427767.703565:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789427767.703594:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427767.703602:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:8526:1876350877076480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427767.703615:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427767.703618:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427767.703619:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789427767.703621:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789427767.705097:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789427767.705126:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789427767.705137:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427767.705159:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427768.523976:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427769.545423:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427770.314354:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877076608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427770.314447:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427770.314598:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877076608 00000100:00100000:1.0:1789427770.314625:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877076608 00000100:00100000:1.0:1789427770.314701:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789427770.314713:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877076608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427770.314759:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789427770.315521:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427770.321880:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877076608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7154us (7418us total) trans 0 rc 0/0 00010000:00080000:2.0:1789427770.321914:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d927480 x1876350877076608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427770.321930:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789427770.321950:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877076608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789427770.574899:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427770.847609:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427770.847650:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427770.847685:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427770.847719:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427770.847755:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857124224 00000100:00100000:0.0:1789427770.847768:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857124224 00000100:00100000:1.0:1789427770.847799:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857124096 00000100:00100000:1.0:1789427770.847804:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857124096 00000100:00100000:1.0:1789427770.847843:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 191 00000100:00100000:0.0:1789427770.847843:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00100000:1.0:1789427770.847853:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2357:x1876350857124096:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427770.847854:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857124224:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427770.847945:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857124352 00000100:00100000:3.0:1789427770.847949:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857124352 00000100:00100000:3.0:1789427770.847980:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857124480 00000100:00100000:3.0:1789427770.847982:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857124480 00000100:00100000:3.0:1789427770.848004:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:3.0:1789427770.848010:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857124352:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427770.848074:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857124224:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 222us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.848083:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00100000:0.0:1789427770.848124:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:0.0:1789427770.848132:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857124480:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427770.853142:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2357:x1876350857124096:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 5271us (5530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427770.853162:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 191 00000100:00100000:3.0:1789427770.855442:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857124352:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 7413us (7772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427770.855460:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:0.0:1789427770.857440:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857124480:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 9293us (9705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427770.857458:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00080000:1.0:1789427770.858194:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427770.858202:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789427770.858207:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427771.337555:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877076736:0@lo:400:kworker.0 00000100:00100000:1.0:1789427771.337680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427771.337741:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877077248:0@lo:400:kworker.0 00000100:00100000:1.0:1789427771.337775:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427771.337782:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877077120:0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.337826:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427771.337861:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877076864:0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.337886:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427771.337913:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933301ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877077376:0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.337934:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427771.337954:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789427771.337960:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877076992:0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.337981:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427771.337997:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877077504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427771.338018:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427771.338051:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877076736 00000100:00100000:2.0:1789427771.338059:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877076736 00000100:00100000:2.0:1789427771.338127:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789427771.338137:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877076736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.338227:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877076736:12345-0@lo:400:kworker.0 Request processed in 90us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427771.338234:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789427771.338269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877077248 00000100:00100000:2.0:1789427771.338273:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877077248 00000100:00100000:2.0:1789427771.338305:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877076864 00000100:00100000:2.0:1789427771.338308:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877076864 00000100:00100000:2.0:1789427771.338319:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877076992 00000100:00100000:2.0:1789427771.338322:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877076992 00000100:00100000:2.0:1789427771.338335:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789427771.338340:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877077248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.338373:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877077248:12345-0@lo:400:kworker.0 Request processed in 32us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427771.338401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789427771.338414:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789427771.339009:0:5835:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789427771.339022:0:5835:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789427771.341163:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877076864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.341315:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877076864:12345-0@lo:400:kworker.0 Request processed in 2891us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427771.341326:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789427771.341361:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789427771.341375:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877076992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427771.342209:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877077504 00000100:00100000:3.0:1789427771.342223:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877077504 00000100:00100000:3.0:1789427771.342290:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789427771.342299:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877077504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427771.342336:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427771.342416:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877077504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (4395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427771.342805:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877076992:12345-0@lo:400:kworker.0 Request processed in 1433us (4820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427771.342814:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789427771.342843:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427771.342851:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427771.343011:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877076992:0@lo:400:kworker.0 00010000:00080000:2.0:1789427771.343030:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411baad80 x1876350877077504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427771.343049:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877077504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427771.343063:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877076864:0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.343139:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877076736:0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.343154:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877077248:0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.343249:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877077120 00000100:00100000:2.0:1789427771.343255:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877077120 00000100:00100000:2.0:1789427771.343289:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877077376 00000100:00100000:2.0:1789427771.343300:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877077376 00000100:00100000:2.0:1789427771.343332:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789427771.343340:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877077120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427771.343376:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789427771.343386:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877077376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427771.343388:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877077120:12345-0@lo:400:kworker.0 Request processed in 49us (5561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427771.343394:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789427771.344371:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789427771.344745:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343f954e00 x1876350877077120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427771.344762:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877077120:0@lo:400:kworker.0 00000100:00100000:1.0:1789427771.347014:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877077376:12345-0@lo:400:kworker.0 Request processed in 3615us (9064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427771.347034:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789427771.347960:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933301ac7800 x1876350877077376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427771.347978:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933301ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877077376:0@lo:400:kworker.0 00010000:00010000:3.0:1789427771.595393:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427772.619106:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789427773.313775:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789427773.647521:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427774.667775:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427775.433679:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427775.433705:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877077632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427775.433804:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427775.436038:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877077632 00000100:00100000:3.0:1789427775.436057:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877077632 00000100:00080000:2.0:1789427775.436147:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427775.436162:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789427775.436208:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877077632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427775.436258:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427775.436364:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877077632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427775.436372:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789427775.436584:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d927100 x1876350877077632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427775.436609:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877077632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789427775.689534:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427775.962081:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427775.962137:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427775.962196:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427775.962229:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427775.962263:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857124608 00000100:00100000:2.0:1789427775.962275:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857124608 00000100:00100000:3.0:1789427775.963975:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857124736 00000100:00100000:3.0:1789427775.963991:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857124736 00000100:00100000:3.0:1789427775.964098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:3.0:1789427775.964110:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857124736:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427775.964213:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857124736:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 105us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427775.964221:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00080000:3.0:1789427775.964247:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427775.964533:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857124992 00000100:00100000:0.0:1789427775.964539:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857124992 00000100:00100000:0.0:1789427775.964579:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857124864 00000100:00100000:0.0:1789427775.964583:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857124864 00000100:00100000:0.0:1789427775.964610:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:0.0:1789427775.964618:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857124992:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427775.964654:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857124992:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 37us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427775.964661:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:0.0:1789427775.964676:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:0.0:1789427775.964683:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857124864:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427775.964707:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857124864:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 25us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427775.964713:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:2.0:1789427775.965447:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 193 00000100:00100000:2.0:1789427775.965478:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2356:x1876350857124608:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427775.965536:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2356:x1876350857124608:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 65us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427775.965544:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 193 00000100:00080000:3.0:1789427775.965919:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427775.965940:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427776.457429:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427776.457461:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877077760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427776.457850:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427776.457939:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877077760 00000100:00100000:3.0:1789427776.457950:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877077760 00000100:00100000:3.0:1789427776.458040:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789427776.458051:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877077760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427776.458101:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427776.458157:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877077760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427776.458209:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789427776.458239:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789427776.458285:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343fac3480 x1876350877077760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427776.458307:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877077760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427776.458596:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877078016:0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.458641:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427776.458675:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789427776.458682:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877077888:0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.458711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427776.458739:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877078400:0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.458762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427776.458791:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877077888 00000100:00100000:0.0:1789427776.458796:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877077888 00000100:00100000:0.0:1789427776.458830:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789427776.458837:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877077888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.458876:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877077888:12345-0@lo:400:kworker.0 Request processed in 39us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427776.458894:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789427776.458926:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877078016 00000100:00100000:0.0:1789427776.458930:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877078016 00000100:00100000:0.0:1789427776.458957:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877078400 00000100:00100000:0.0:1789427776.458959:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877078400 00000100:00100000:0.0:1789427776.458985:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427776.459009:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877078016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.459041:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877078016:12345-0@lo:400:kworker.0 Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427776.459047:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427776.459059:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789427776.459064:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877078400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.459092:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877078400:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427776.459098:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789427776.459126:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427776.459167:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877078272:0@lo:400:kworker.0 00000100:00100000:2.0:1789427776.459221:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427776.459244:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427776.459250:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877078144:0@lo:400:kworker.0 00000100:00100000:2.0:1789427776.459272:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427776.459433:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877078272 00000100:00100000:0.0:1789427776.459438:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877078272 00000100:00100000:0.0:1789427776.459467:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789427776.459474:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877078272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.459513:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877078272:12345-0@lo:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427776.459519:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789427776.459558:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d925f80 x1876350877078272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427776.459570:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877078272:0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.459598:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877078144 00000100:00100000:0.0:1789427776.459602:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877078144 00000100:00100000:0.0:1789427776.459627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789427776.459632:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877078144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.459665:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877078144:12345-0@lo:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427776.459671:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789427776.459685:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427776.459701:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877078144:0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.459723:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877077888:0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.459732:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877078400:0@lo:400:kworker.0 00000100:00100000:0.0:1789427776.459741:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877078016:0@lo:400:kworker.0 00010000:00010000:1.0:1789427776.716803:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427777.738792:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789427777.790393:0:9046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing yml_node 00010000:00010000:3.0:1789427778.761395:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427779.785716:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427780.553639:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877078528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427780.553741:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427780.554050:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877078528 00000100:00100000:1.0:1789427780.554061:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877078528 00000100:00100000:1.0:1789427780.554143:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789427780.554154:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877078528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427780.554228:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427780.554284:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877078528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427780.554291:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789427780.554333:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d926d80 x1876350877078528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427780.554352:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877078528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789427780.554486:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789427780.810440:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427781.081983:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427781.082040:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427781.084201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857125248 00000100:00100000:3.0:1789427781.084221:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857125248 00000100:00100000:3.0:1789427781.084321:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 38 00000100:00100000:3.0:1789427781.084334:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857125248:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427781.084446:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857125248:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 115us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427781.084455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 38 00000100:00080000:3.0:1789427781.084485:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427781.085075:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857125120 00000100:00100000:2.0:1789427781.085082:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857125120 00000100:00100000:2.0:1789427781.085125:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 195 00000100:00100000:2.0:1789427781.085134:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2355:x1876350857125120:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427781.085205:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2355:x1876350857125120:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 71us (3237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427781.085211:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 195 00000100:00100000:2.0:1789427781.089144:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427781.089226:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427781.089860:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857125376 00000100:00100000:1.0:1789427781.089874:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857125376 00000100:00100000:1.0:1789427781.090528:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857125504 00000100:00100000:1.0:1789427781.090535:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857125504 00000100:00100000:1.0:1789427781.090581:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:1.0:1789427781.090594:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2353:x1876350857125376:12345-192.168.201.55@tcp:9:kworker.0 00000020:00000080:1.0:1789427781.090644:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3432ea 00000100:00080000:1.0:1789427781.090656:0:6682:0:(import.c:65:import_set_state_nolock()) ffff93343faa8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789427781.090718:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789427781.091248:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+2:2353:x1876350857125376:12345-192.168.201.55@tcp:9:kworker.0 Request processed in 655us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427781.091257:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:1.0:1789427781.091289:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:1.0:1789427781.091297:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2353:x1876350857125504:12345-192.168.201.55@tcp:9:kworker.0 00000020:00000080:1.0:1789427781.091314:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3432f1 00000100:00080000:1.0:1789427781.091321:0:6682:0:(import.c:65:import_set_state_nolock()) ffff93343faad800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789427781.093684:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427781.093694:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1789427781.095618:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789427781.096129:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+2:2353:x1876350857125504:12345-192.168.201.55@tcp:9:kworker.0 Request processed in 4822us (6892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427781.096143:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00010000:00010000:0.0:1789427781.096455:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427781.099031:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427781.585635:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427781.585670:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877078656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427781.585764:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427781.585852:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877078656 00000100:00100000:1.0:1789427781.585862:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877078656 00000100:00100000:1.0:1789427781.585951:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789427781.585963:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877078656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427781.586014:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427781.586072:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877078656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427781.586079:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789427781.586106:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789427781.586144:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411baa300 x1876350877078656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427781.586209:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877078656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427781.587737:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877078912:0@lo:400:kworker.0 00000100:00100000:0.0:1789427781.587804:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427781.587838:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427781.587844:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877079040:0@lo:400:kworker.0 00000100:00100000:0.0:1789427781.587862:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427781.587889:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877078912 00000100:00100000:0.0:1789427781.587896:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877078912 00000100:00100000:0.0:1789427781.587956:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877079040 00000100:00100000:0.0:1789427781.587960:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877079040 00000100:00100000:0.0:1789427781.587994:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789427781.588011:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877078912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427781.588065:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877078912:12345-0@lo:400:kworker.0 Request processed in 57us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427781.588072:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789427781.588090:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789427781.588097:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877079040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427781.588123:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877079040:12345-0@lo:400:kworker.0 Request processed in 27us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427781.588128:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789427781.588203:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877079040:0@lo:400:kworker.0 00000100:00100000:0.0:1789427781.588215:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877078912:0@lo:400:kworker.0 00000100:00100000:2.0:1789427781.588448:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877079168:0@lo:400:kworker.0 00000100:00100000:2.0:1789427781.588486:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427781.588511:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789427781.588516:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877078784:0@lo:400:kworker.0 00000100:00100000:2.0:1789427781.588544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427781.588571:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877079296:0@lo:400:kworker.0 00000100:00100000:2.0:1789427781.588591:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427781.588621:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877079168 00000100:00100000:2.0:1789427781.588625:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877079168 00000100:00100000:2.0:1789427781.588661:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789427781.588668:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877079168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427781.588707:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877079168:12345-0@lo:400:kworker.0 Request processed in 39us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427781.588713:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789427781.588746:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877078784 00000100:00100000:2.0:1789427781.588750:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877078784 00000100:00100000:2.0:1789427781.588777:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789427781.588784:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877078784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427781.588815:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877078784:12345-0@lo:400:kworker.0 Request processed in 32us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427781.588821:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789427781.588845:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877079296 00000100:00100000:2.0:1789427781.588849:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877079296 00000100:00100000:2.0:1789427781.588875:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789427781.588881:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877079296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427781.588920:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877079296:12345-0@lo:400:kworker.0 Request processed in 39us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427781.588926:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789427781.588961:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877078784:0@lo:400:kworker.0 00000100:00100000:2.0:1789427781.588972:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877079296:0@lo:400:kworker.0 00010000:00080000:2.0:1789427781.588984:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d926d80 x1876350877079168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427781.588994:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877079168:0@lo:400:kworker.0 00000100:00080000:1.0:1789427781.590412:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789427781.694913:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:0.0:1789427781.694928:0:6710:0:(genops.c:885:class_export_put()) final put ffff93343faab000/691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:2.0:1789427781.695622:0:1363:0:(genops.c:844:class_export_destroy()) destroying export ffff93343faab000/691432fe-93d9-4afe-b1ac-013e2024784c for lustre-OST0000 00000020:00000080:2.0:1789427781.708640:0:1363:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93343faa8000 for lustre-OST0000 00000001:02000400:0.0:1789427781.719771:0:9239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.41 00010000:00010000:3.0:1789427781.833345:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427782.857787:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427783.881369:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789427784.731667:0:9336:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.41 00010000:00010000:1.0:1789427784.906374:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427785.673465:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427785.673497:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877079424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427785.673590:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427785.673866:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877079424 00000100:00100000:0.0:1789427785.673876:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877079424 00000100:00100000:0.0:1789427785.673959:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789427785.673970:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877079424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427785.674015:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427785.674071:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877079424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427785.674079:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789427785.674137:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789427785.674237:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b1b0a80 x1876350877079424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427785.674262:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877079424:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789427785.818877:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:3.0:1789427785.818891:0:7637:0:(genops.c:885:class_export_put()) final put ffff93343faaa000/691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:0.0:1789427785.819028:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93343faaa000/691432fe-93d9-4afe-b1ac-013e2024784c for lustre-OST0001 00000020:00000080:0.0:1789427785.824579:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93343faad800 for lustre-OST0001 00010000:00010000:2.0:1789427785.931886:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427786.200964:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427786.201021:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857125632 00000100:00100000:0.0:1789427786.201032:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427786.201035:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857125632 00000100:00100000:3.0:1789427786.201118:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 197 00000100:00100000:3.0:1789427786.201130:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2355:x1876350857125632:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427786.201269:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2355:x1876350857125632:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 140us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427786.201277:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 197 00000100:00100000:1.0:1789427786.207033:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857125760 00000100:00100000:1.0:1789427786.207056:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857125760 00000100:00100000:1.0:1789427786.207163:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00080000:2.0:1789427786.207170:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427786.207196:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857125760:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427786.207307:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857125760:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 133us (6273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427786.208288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:3.0:1789427786.697507:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877079680:0@lo:400:kworker.0 00000100:00100000:3.0:1789427786.697614:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427786.697675:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877080192:0@lo:400:kworker.0 00000100:00100000:0.0:1789427786.697684:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877079808:0@lo:400:kworker.0 00000100:00100000:3.0:1789427786.697722:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427786.697745:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427786.697766:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877080320:0@lo:400:kworker.0 00000100:00100000:0.0:1789427786.697792:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427786.697922:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877080320 00000100:00100000:3.0:1789427786.697933:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877080320 00000100:00100000:2.0:1789427786.698054:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877080064:0@lo:400:kworker.0 00000100:00100000:3.0:1789427786.698076:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789427786.698090:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877080320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427786.698091:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427786.698115:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427786.698122:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877079936:0@lo:400:kworker.0 00000100:00100000:2.0:1789427786.698152:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427786.698169:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877080320:12345-0@lo:400:kworker.0 Request processed in 82us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427786.698203:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789427786.698222:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877080064 00000100:00100000:3.0:1789427786.698226:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877080064 00000100:00100000:3.0:1789427786.698254:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427786.698261:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877080064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427786.698307:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877080064:12345-0@lo:400:kworker.0 Request processed in 45us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427786.698311:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877079680 00000100:00100000:3.0:1789427786.698316:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789427786.698318:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877079680 00000100:00100000:2.0:1789427786.698354:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789427786.698363:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877079680:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789427786.698368:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b1b0000 x1876350877080064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427786.698386:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877080064:0@lo:400:kworker.0 00000100:00100000:2.0:1789427786.698403:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877079680:12345-0@lo:400:kworker.0 Request processed in 40us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427786.698410:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:3.0:1789427786.698424:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b1b0380 x1876350877080320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427786.698441:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877080192 00000100:00100000:2.0:1789427786.698445:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877080192 00000100:00100000:3.0:1789427786.698456:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877080320:0@lo:400:kworker.0 00000100:00100000:2.0:1789427786.698476:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877079808 00000100:00100000:2.0:1789427786.698479:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877079808 00000100:00100000:2.0:1789427786.698495:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877079936 00000100:00100000:2.0:1789427786.698497:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877079936 00000100:00100000:3.0:1789427786.698508:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877079680:0@lo:400:kworker.0 00000100:00100000:2.0:1789427786.698515:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789427786.698522:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877080192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427786.698558:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877080192:12345-0@lo:400:kworker.0 Request processed in 36us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427786.698576:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789427786.698582:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789427786.698592:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789427786.698594:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877079808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427786.698602:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877079936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427786.698649:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877079808:12345-0@lo:400:kworker.0 Request processed in 58us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427786.698651:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877079936:12345-0@lo:400:kworker.0 Request processed in 50us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427786.698665:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789427786.698729:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877079808:0@lo:400:kworker.0 00000100:00080000:0.0:1789427786.698738:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427786.698746:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427786.698755:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877080192:0@lo:400:kworker.0 00000100:00100000:2.0:1789427786.698874:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877079936:0@lo:400:kworker.0 00000100:00100000:1.0:1789427786.700923:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427786.700959:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877079552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427786.701044:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427786.701221:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877079552 00000100:00100000:0.0:1789427786.701232:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877079552 00000100:00100000:0.0:1789427786.701287:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789427786.701298:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877079552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427786.701339:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427786.701398:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877079552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427786.701405:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789427786.701697:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789427786.702023:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411baa300 x1876350877079552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427786.702050:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877079552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789427786.959488:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789427787.676948:0:9436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.41 00010000:00010000:2.0:1789427787.977573:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427789.001718:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789427789.773012:0:9484:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 14 19:16:28 EDT 2026 00010000:00010000:2.0:1789427790.031095:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427790.794990:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877080448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427790.795084:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427790.796366:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877080448 00000100:00100000:0.0:1789427790.796383:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877080448 00000100:00100000:0.0:1789427790.796463:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789427790.796474:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877080448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427790.796527:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427790.796607:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877080448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427790.796615:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789427790.796641:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789427790.797684:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343fac3100 x1876350877080448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427790.797731:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877080448:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789427791.051430:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427791.321342:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427791.321395:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427791.321495:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857125888 00000100:00100000:3.0:1789427791.321508:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857125888 00000100:00100000:3.0:1789427791.321581:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 199 00000100:00100000:3.0:1789427791.321592:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2356:x1876350857125888:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427791.321689:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2356:x1876350857125888:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427791.321697:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 199 00000100:00100000:1.0:1789427791.325245:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857126016 00000100:00100000:1.0:1789427791.325270:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857126016 00000100:00100000:1.0:1789427791.325364:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 46 00000100:00100000:1.0:1789427791.325376:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857126016:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427791.325494:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857126016:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 120us (4167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427791.325512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 46 00000100:00080000:0.0:1789427791.327855:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427791.818527:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427791.818559:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877080576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427791.818798:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427791.819540:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877080960:0@lo:400:kworker.0 00000100:00100000:0.0:1789427791.819579:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427791.819603:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427791.819608:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877081088:0@lo:400:kworker.0 00000100:00100000:1.0:1789427791.819816:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877080576 00000100:00100000:1.0:1789427791.819883:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877080576 00000100:00100000:1.0:1789427791.819964:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789427791.819977:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877080576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427791.820029:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427791.820086:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877080576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427791.820095:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789427791.820147:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427791.820160:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877080960 00000100:00100000:1.0:1789427791.820165:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877080960 00000100:00100000:1.0:1789427791.820223:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789427791.820230:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877080960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427791.820265:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877080960:12345-0@lo:400:kworker.0 Request processed in 35us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427791.820272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789427791.820287:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427791.821834:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427791.821935:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877080960:0@lo:400:kworker.0 00010000:00080000:0.0:1789427791.821956:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343fac3100 x1876350877080576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427791.821979:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877080576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427791.822079:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877081088 00000100:00100000:0.0:1789427791.822087:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877081088 00000100:00100000:0.0:1789427791.822144:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789427791.822153:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877081088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427791.822244:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877081088:12345-0@lo:400:kworker.0 Request processed in 92us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427791.822252:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789427791.822287:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae61f80 x1876350877081088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427791.822298:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877081088:0@lo:400:kworker.0 00000100:00100000:2.0:1789427791.822681:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877080704:0@lo:400:kworker.0 00000100:00100000:2.0:1789427791.822746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427791.822788:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877081216:0@lo:400:kworker.0 00000100:00100000:2.0:1789427791.822817:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427791.822845:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789427791.822852:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877080832:0@lo:400:kworker.0 00000100:00100000:2.0:1789427791.822873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427791.822889:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877081344:0@lo:400:kworker.0 00000100:00100000:2.0:1789427791.822911:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427791.822943:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877081344 00000100:00100000:2.0:1789427791.822966:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877081344 00000100:00100000:2.0:1789427791.822995:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789427791.823002:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877081344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427791.823043:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877081344:12345-0@lo:400:kworker.0 Request processed in 41us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427791.823050:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789427791.823082:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae60380 x1876350877081344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427791.823093:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877081344:0@lo:400:kworker.0 00000100:00100000:1.0:1789427791.825036:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877081216 00000100:00100000:1.0:1789427791.825054:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877081216 00000100:00100000:1.0:1789427791.825132:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877080832 00000100:00100000:1.0:1789427791.825136:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877080832 00000100:00100000:1.0:1789427791.825167:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789427791.825209:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877081216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427791.825328:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877081216:12345-0@lo:400:kworker.0 Request processed in 152us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427791.825337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789427791.825376:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789427791.825383:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877080832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427791.825429:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877080832:12345-0@lo:400:kworker.0 Request processed in 47us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427791.825435:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789427791.825488:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877080832:0@lo:400:kworker.0 00000100:00100000:1.0:1789427791.825502:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877081216:0@lo:400:kworker.0 00000100:00080000:3.0:1789427791.825765:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427791.825837:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877080704 00000100:00100000:0.0:1789427791.825844:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877080704 00000100:00100000:0.0:1789427791.825899:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789427791.825907:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877080704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427791.825963:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877080704:12345-0@lo:400:kworker.0 Request processed in 57us (3217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427791.825969:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789427791.827022:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877080704:0@lo:400:kworker.0 00010000:00010000:2.0:1789427792.075584:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427793.097984:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427794.121836:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427795.147321:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427795.914168:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427795.914221:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877081472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427795.914311:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427795.914449:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877081472 00000100:00100000:1.0:1789427795.914460:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877081472 00000100:00100000:1.0:1789427795.914537:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789427795.914549:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877081472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427795.914591:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427795.914662:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877081472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427795.914670:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789427795.914733:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae61180 x1876350877081472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427795.914755:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877081472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789427795.914919:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789427796.169451:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427796.444847:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427796.444912:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427796.444954:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857126144 00000100:00100000:0.0:1789427796.444968:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857126144 00000100:00100000:0.0:1789427796.445054:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 201 00000100:00100000:0.0:1789427796.445066:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2356:x1876350857126144:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427796.445164:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2356:x1876350857126144:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 100us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427796.445194:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 201 00000100:00100000:3.0:1789427796.445411:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857126272 00000100:00100000:3.0:1789427796.445417:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857126272 00000100:00100000:3.0:1789427796.445477:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00100000:3.0:1789427796.445485:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857126272:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427796.445531:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857126272:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 48us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427796.445537:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00080000:0.0:1789427796.446306:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427796.940542:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877081984:0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.940778:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427796.940868:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789427796.940876:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877081600:0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.940911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427796.940946:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877082112:0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.940976:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427796.941006:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877081856:0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.941032:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427796.941053:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789427796.941058:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877081728:0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.941078:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427796.941108:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b6c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877082240:0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.941331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427796.941366:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877081984 00000100:00100000:2.0:1789427796.941374:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877081984 00000100:00100000:2.0:1789427796.941432:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877082240 00000100:00100000:2.0:1789427796.941436:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877082240 00000100:00100000:1.0:1789427796.941572:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877082112 00000100:00100000:1.0:1789427796.941576:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877082112 00000100:00100000:2.0:1789427796.941659:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789427796.941670:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877081984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.941737:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877081984:12345-0@lo:400:kworker.0 Request processed in 69us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427796.941745:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789427796.941764:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789427796.941770:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877082240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.941811:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877082240:12345-0@lo:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427796.941818:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789427796.941840:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877081856 00000100:00100000:2.0:1789427796.941844:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877081856 00000100:00100000:3.0:1789427796.941931:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877081600 00000100:00100000:3.0:1789427796.941936:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877081600 00000100:00100000:3.0:1789427796.941970:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789427796.941978:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877081600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427796.942016:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877081600:12345-0@lo:400:kworker.0 Request processed in 39us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427796.942022:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789427796.942054:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877081728 00000100:00100000:3.0:1789427796.942058:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877081728 00000100:00100000:3.0:1789427796.942088:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789427796.942095:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877081728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427796.942147:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877081728:12345-0@lo:400:kworker.0 Request processed in 53us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427796.942154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789427796.946516:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427796.946555:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877082368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427796.946698:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427796.947745:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877082368 00000100:00100000:0.0:1789427796.947759:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877082368 00000100:00100000:0.0:1789427796.947866:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789427796.947877:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877082368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427796.947928:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427796.948008:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877082368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427796.948017:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789427796.948092:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae61180 x1876350877082368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427796.949304:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877082368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427796.950887:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789427796.950903:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877082112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427796.951011:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877082112:12345-0@lo:400:kworker.0 Request processed in 113us (10034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427796.951028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789427796.951853:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877081600:0@lo:400:kworker.0 00000100:00100000:1.0:1789427796.951882:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877082112:0@lo:400:kworker.0 00010000:00080000:1.0:1789427796.951900:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b6c1c00 x1876350877081984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427796.951912:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877081984:0@lo:400:kworker.0 00000100:00080000:1.0:1789427796.951962:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789427796.951970:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427796.953979:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877081728:0@lo:400:kworker.0 00010000:00080000:1.0:1789427796.954005:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b6c2680 x1876350877082240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427796.954016:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b6c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877082240:0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.958493:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789427796.958511:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877081856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427796.958779:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877081856:12345-0@lo:400:kworker.0 Request processed in 273us (17746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427796.958788:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789427796.959473:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877081856:0@lo:400:kworker.0 00010000:00010000:3.0:1789427797.194717:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427798.217753:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427799.241323:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427800.265485:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427801.033662:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427801.033693:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877082496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427801.033781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427801.033939:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877082496 00000100:00100000:2.0:1789427801.033949:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877082496 00000100:00100000:2.0:1789427801.034032:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789427801.034046:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411babb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877082496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427801.034113:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427801.034170:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411babb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877082496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427801.034204:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789427801.034673:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411baa300 x1876350877082496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427801.034697:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877082496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789427801.035041:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789427801.294539:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427801.560218:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427801.560262:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427801.564319:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857126400 00000100:00100000:1.0:1789427801.564336:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857126400 00000100:00100000:1.0:1789427801.564396:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 203 00000100:00100000:1.0:1789427801.564407:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2357:x1876350857126400:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427801.564489:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2357:x1876350857126400:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 83us (4280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427801.564510:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 203 00000100:00100000:1.0:1789427801.564563:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857126528 00000100:00100000:1.0:1789427801.564568:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857126528 00000100:00100000:1.0:1789427801.564616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 54 00000100:00100000:1.0:1789427801.564623:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857126528:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427801.564658:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857126528:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 35us (4396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427801.564665:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 54 00000100:00080000:1.0:1789427801.565067:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427802.057776:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877082624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427802.057861:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427802.058200:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877082624 00000100:00100000:3.0:1789427802.058224:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877082624 00000100:00100000:3.0:1789427802.058292:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789427802.058301:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877082624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427802.058339:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427802.058387:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877082624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427802.058394:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789427802.058433:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae60380 x1876350877082624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427802.058452:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877082624:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789427802.064553:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427802.064601:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877082752:0@lo:400:kworker.0 00000100:00100000:1.0:1789427802.064627:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877083008:0@lo:400:kworker.0 00000100:00100000:2.0:1789427802.064702:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877082880:0@lo:400:kworker.0 00000100:00100000:1.0:1789427802.068851:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427802.068917:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427802.068931:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877083136:0@lo:400:kworker.0 00000100:00100000:1.0:1789427802.068975:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427802.069017:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877083008 00000100:00100000:1.0:1789427802.069404:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877083008 00000100:00100000:1.0:1789427802.069475:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789427802.069485:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877083008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427802.069555:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877083008:12345-0@lo:400:kworker.0 Request processed in 71us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427802.069562:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789427802.069588:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877083136 00000100:00100000:1.0:1789427802.069592:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877083136 00000100:00100000:1.0:1789427802.069618:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789427802.069625:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411baad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877083136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427802.069656:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411baad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877083136:12345-0@lo:400:kworker.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427802.069678:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789427802.069726:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411ba8700 x1876350877083136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427802.077349:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877083136:0@lo:400:kworker.0 00000100:00100000:1.0:1789427802.077387:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877083008:0@lo:400:kworker.0 00000100:00080000:1.0:1789427802.077448:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427802.080470:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427802.080567:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877083264:0@lo:400:kworker.0 00000100:00100000:0.0:1789427802.080624:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427802.080657:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877083264 00000100:00100000:0.0:1789427802.080666:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877083264 00000100:00100000:0.0:1789427802.080733:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789427802.080744:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877083264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427802.080799:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877083264:12345-0@lo:400:kworker.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427802.080807:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789427802.080855:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877083264:0@lo:400:kworker.0 00000100:00100000:1.0:1789427802.080987:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877082752 00000100:00100000:1.0:1789427802.080991:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877082752 00000100:00100000:1.0:1789427802.081027:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789427802.081035:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877082752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427802.081074:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877082752:12345-0@lo:400:kworker.0 Request processed in 41us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427802.081080:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:1.0:1789427802.081107:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427802.084673:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877082752:0@lo:400:kworker.0 00000100:00100000:2.0:1789427802.085613:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427802.088127:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877082880 00000100:00100000:1.0:1789427802.088140:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877082880 00000100:00100000:1.0:1789427802.088199:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789427802.088208:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877082880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427802.088286:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877082880:12345-0@lo:400:kworker.0 Request processed in 79us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427802.088292:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789427802.088337:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877082880:0@lo:400:kworker.0 00010000:00010000:0.0:1789427802.317283:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427803.337466:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427804.368594:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427805.385574:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427806.154379:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877083392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427806.154471:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427806.154600:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877083392 00000100:00100000:2.0:1789427806.154610:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877083392 00000100:00100000:2.0:1789427806.154673:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789427806.154682:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877083392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427806.154717:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427806.154757:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877083392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427806.154763:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789427806.154935:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789427806.154965:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b6c1880 x1876350877083392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427806.154983:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877083392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789427806.409438:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427806.681675:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427806.681759:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427806.681932:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857126784 00000100:00100000:0.0:1789427806.681943:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857126784 00000100:00100000:0.0:1789427806.682033:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 58 00000100:00100000:0.0:1789427806.682044:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857126784:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427806.682127:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857126784:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 85us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427806.682135:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 58 00000100:00080000:2.0:1789427806.682555:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427806.682771:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857126656 00000100:00100000:1.0:1789427806.682777:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857126656 00000100:00100000:1.0:1789427806.682824:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 205 00000100:00100000:1.0:1789427806.682846:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2355:x1876350857126656:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427806.682896:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2355:x1876350857126656:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 51us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427806.682902:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 205 00000100:00100000:2.0:1789427807.177576:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877083520:0@lo:400:kworker.0 00000100:00100000:2.0:1789427807.177672:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427807.177723:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877084032:0@lo:400:kworker.0 00000100:00100000:2.0:1789427807.177748:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427807.177772:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789427807.177793:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877083648:0@lo:400:kworker.0 00000100:00100000:2.0:1789427807.177815:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427807.177829:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877084160:0@lo:400:kworker.0 00000100:00100000:2.0:1789427807.177849:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427807.178064:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877083520 00000100:00100000:1.0:1789427807.178074:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877083520 00000100:00100000:0.0:1789427807.178212:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877083776:0@lo:400:kworker.0 00000100:00100000:0.0:1789427807.178244:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427807.178266:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427807.178272:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877083904:0@lo:400:kworker.0 00000100:00100000:0.0:1789427807.178294:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427807.178324:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877084032 00000100:00100000:0.0:1789427807.178327:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877084032 00000100:00100000:0.0:1789427807.178362:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877083648 00000100:00100000:0.0:1789427807.178365:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877083648 00000100:00100000:0.0:1789427807.178375:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877083776 00000100:00100000:0.0:1789427807.178377:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877083776 00000100:00100000:0.0:1789427807.178392:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789427807.178400:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877084032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427807.178571:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877084032:12345-0@lo:400:kworker.0 Request processed in 172us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427807.178589:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789427807.178607:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789427807.178612:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877083648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427807.178640:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877083648:12345-0@lo:400:kworker.0 Request processed in 28us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427807.178645:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789427807.178656:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789427807.178662:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877083776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427807.178692:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877083776:12345-0@lo:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427807.178698:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789427807.178716:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00080000:0.0:1789427807.178716:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427807.178724:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877083520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427807.178743:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877083776:0@lo:400:kworker.0 00000100:00100000:1.0:1789427807.178755:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877083520:12345-0@lo:400:kworker.0 Request processed in 34us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427807.178761:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789427807.178770:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877083648:0@lo:400:kworker.0 00000100:00100000:0.0:1789427807.178778:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877083520:0@lo:400:kworker.0 00000100:00100000:0.0:1789427807.178786:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877084032:0@lo:400:kworker.0 00000100:00100000:3.0:1789427807.179463:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877084160 00000100:00100000:3.0:1789427807.179473:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877084160 00000100:00100000:3.0:1789427807.179512:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877083904 00000100:00100000:3.0:1789427807.179515:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877083904 00000100:00100000:3.0:1789427807.179536:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789427807.179543:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877084160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427807.179590:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877084160:12345-0@lo:400:kworker.0 Request processed in 49us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427807.179597:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789427807.179610:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789427807.179615:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877083904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427807.179642:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877083904:12345-0@lo:400:kworker.0 Request processed in 27us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427807.179646:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789427807.179689:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427807.179701:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877084288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427807.179738:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789427807.179767:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789427807.179792:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411ba9880 x1876350877083904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427807.179805:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877083904:0@lo:400:kworker.0 00000100:00100000:3.0:1789427807.179834:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877084288 00000100:00100000:3.0:1789427807.179838:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877084288 00000100:00100000:3.0:1789427807.179865:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789427807.179870:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877084288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427807.179906:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427807.179945:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877084288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427807.179952:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789427807.179975:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae61f80 x1876350877084288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427807.179991:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877084288:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789427807.182980:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411bab100 x1876350877084160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427807.182997:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877084160:0@lo:400:kworker.0 00010000:00010000:0.0:1789427807.433536:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427808.457508:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789427808.670641:0:10115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:16:47 (1789427807) === 00000100:00100000:3.0:1789427809.052067:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427809.052925:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857126912 00000100:00100000:0.0:1789427809.052941:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857126912 00000100:00100000:0.0:1789427809.053039:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 207 00000100:00100000:0.0:1789427809.053051:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:8122:x1876350857126912:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789427809.053069:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427809.053090:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e179400/0x2bea1a57ca3433b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8662 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427809.053121:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e179400/0x2bea1a57ca3433b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8662 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427809.053132:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e179400/0x2bea1a57ca3433b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8662 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427809.053142:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179400, rc 0) 00000100:00100000:0.0:1789427809.053255:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8122:x1876350857126912:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 204us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427809.053263:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 207 00000100:00100000:2.0:1789427809.068369:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427809.069525:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857127040 00000100:00100000:1.0:1789427809.069548:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857127040 00000100:00100000:1.0:1789427809.069646:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 208 00000100:00100000:1.0:1789427809.069659:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8122:x1876350857127040:12345-192.168.201.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789427809.070027:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8122:x1876350857127040:12345-192.168.201.55@tcp:501:mount.lustre.0 Request processed in 369us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427809.070036:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 208 00000100:00100000:3.0:1789427809.075441:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427809.075519:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857127168 00000100:00100000:2.0:1789427809.075538:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857127168 00000100:00100000:2.0:1789427809.075630:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 209 00000100:00100000:2.0:1789427809.075642:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8122:x1876350857127168:12345-192.168.201.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789427809.075884:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8122:x1876350857127168:12345-192.168.201.55@tcp:503:mount.lustre.0 Request processed in 244us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427809.075893:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 209 00000100:00100000:2.0:1789427809.086553:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427809.087105:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857127296 00000100:00100000:0.0:1789427809.087122:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857127296 00000100:00100000:0.0:1789427809.087228:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 210 00000100:00100000:0.0:1789427809.087239:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8126:x1876350857127296:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789427809.087557:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8126:x1876350857127296:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 320us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427809.087566:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 210 00000100:00100000:3.0:1789427809.106233:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427809.107531:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857127424 00000100:00100000:1.0:1789427809.107552:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857127424 00000100:00100000:1.0:1789427809.107624:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 211 00000100:00100000:1.0:1789427809.107636:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8126:x1876350857127424:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789427809.107950:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8126:x1876350857127424:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 315us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427809.107958:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 211 00000100:00100000:3.0:1789427809.114731:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427809.116754:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857127552 00000100:00100000:2.0:1789427809.116791:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857127552 00000100:00100000:2.0:1789427809.116908:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 212 00000100:00100000:2.0:1789427809.116925:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:8122:x1876350857127552:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789427809.116952:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427809.116985:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02b600/0x2bea1a57ca3433bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a868c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427809.117028:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02b600/0x2bea1a57ca3433bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a868c expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427809.117042:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02b600/0x2bea1a57ca3433bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a868c expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427809.117078:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02b600, rc 0) 00000100:00100000:2.0:1789427809.117162:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:8122:x1876350857127552:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 242us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427809.117167:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 212 00000100:00100000:2.0:1789427809.128356:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427809.128462:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857127680 00000100:00100000:1.0:1789427809.128481:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857127680 00000100:00100000:1.0:1789427809.128554:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 213 00000100:00100000:1.0:1789427809.128566:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:8122:x1876350857127680:12345-192.168.201.55@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789427809.128593:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789427809.128618:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789427809.128622:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789427809.128625:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789427809.128627:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789427809.130771:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:8122:x1876350857127680:12345-192.168.201.55@tcp:256:mount.lustre.0 Request processed in 2196us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427809.130787:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 213 00000100:00100000:3.0:1789427809.135035:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427809.135146:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857127808 00000100:00100000:2.0:1789427809.135157:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857127808 00000100:00100000:2.0:1789427809.135225:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 214 00000100:00100000:2.0:1789427809.135233:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:8122:x1876350857127808:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789427809.135250:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427809.135264:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8693 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427809.135287:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8693 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427809.135296:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8693 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427809.135303:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02aa00, rc 0) 00000100:00100000:2.0:1789427809.135351:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:8122:x1876350857127808:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 120us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427809.135357:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 214 00000100:00100000:2.0:1789427809.137746:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427809.137865:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857127936 00000100:00100000:1.0:1789427809.137875:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857127936 00000100:00100000:1.0:1789427809.138045:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 215 00000100:00100000:1.0:1789427809.138055:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:8122:x1876350857127936:12345-192.168.201.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789427809.138358:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:8122:x1876350857127936:12345-192.168.201.55@tcp:501:mount.lustre.0 Request processed in 304us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427809.138365:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 215 00000100:00100000:3.0:1789427809.140591:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427809.140671:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857128064 00000100:00100000:2.0:1789427809.140681:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857128064 00000100:00100000:2.0:1789427809.140747:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 216 00000100:00100000:2.0:1789427809.140758:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:8122:x1876350857128064:12345-192.168.201.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789427809.140991:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:8122:x1876350857128064:12345-192.168.201.55@tcp:503:mount.lustre.0 Request processed in 233us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427809.141000:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 216 00000100:00100000:3.0:1789427809.143831:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427809.144073:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857128192 00000100:00100000:1.0:1789427809.144083:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857128192 00000100:00100000:1.0:1789427809.144141:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 217 00000100:00100000:1.0:1789427809.144151:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:8130:x1876350857128192:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789427809.144439:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:8130:x1876350857128192:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 288us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427809.144448:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 217 00000100:00100000:1.0:1789427809.148124:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427809.148199:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857128320 00000100:00100000:2.0:1789427809.148208:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857128320 00000100:00100000:2.0:1789427809.148253:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 218 00000100:00100000:2.0:1789427809.148261:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:8130:x1876350857128320:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789427809.148550:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:8130:x1876350857128320:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 287us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427809.148558:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 218 00000100:00100000:2.0:1789427809.153787:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427809.153834:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427809.154011:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857128576 00000100:00100000:3.0:1789427809.154031:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857128576 00000100:00100000:0.0:1789427809.154033:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857128448 00000100:00100000:0.0:1789427809.154037:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857128448 00000100:00080000:1.0:1789427809.154137:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427809.154214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 62 00000100:00100000:0.0:1789427809.154266:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857128576:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427809.154267:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:3.0:1789427809.154272:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1876350857128448:12345-192.168.201.55@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789427809.154298:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6a378096-12fe-46c6-8e00-dd5f71de0c2d@192.168.201.55@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1789427809.154338:0:5836:0:(genops.c:1384:class_connect()) connect: client 6a378096-12fe-46c6-8e00-dd5f71de0c2d, cookie 0x2bea1a57ca3433ca 00000100:00100000:0.0:1789427809.154344:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857128576:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 84us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427809.154351:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 62 00000004:00100000:3.0:1789427809.154367:0:5836:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789427809.154637:0:5836:0:(import.c:65:import_set_state_nolock()) ffff93340f108000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789427809.154828:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:2353:x1876350857128448:12345-192.168.201.55@tcp:38:mount.lustre.0 Request processed in 554us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427809.154836:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:0.0:1789427809.160354:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427809.160451:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857128704 00000100:00100000:0.0:1789427809.160456:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427809.160463:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857128704 00000100:00080000:1.0:1789427809.160536:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427809.160640:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857128832 00000100:00100000:3.0:1789427809.160645:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857128832 00000100:00100000:2.0:1789427809.160747:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:2.0:1789427809.160759:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+7:0:x1876350857128704:12345-192.168.201.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789427809.160807:0:5835:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789427809.160922:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+7:0:x1876350857128704:12345-192.168.201.55@tcp:41:mount.lustre.0 Request processed in 165us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427809.160930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:3.0:1789427809.163523:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:3.0:1789427809.163543:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:8122:x1876350857128832:12345-192.168.201.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789427809.163579:0:5836:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789427809.163656:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:8122:x1876350857128832:12345-192.168.201.55@tcp:41:mount.lustre.0 Request processed in 122us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427809.163665:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:0.0:1789427809.174172:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427809.175391:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857128960 00000100:00100000:2.0:1789427809.175440:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857128960 00000100:00100000:2.0:1789427809.175504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:2.0:1789427809.175515:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:8122:x1876350857128960:12345-192.168.201.55@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789427809.175664:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:8122:x1876350857128960:12345-192.168.201.55@tcp:40:mount.lustre.0 Request processed in 151us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427809.175672:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:0.0:1789427809.184590:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427809.184626:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427809.184660:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427809.184671:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857129088 00000100:00100000:3.0:1789427809.184682:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857129088 00000100:00100000:3.0:1789427809.184767:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857129216 00000100:00100000:3.0:1789427809.184772:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857129216 00000100:00100000:2.0:1789427809.184778:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857129344 00000100:00100000:2.0:1789427809.184782:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857129344 00000100:00100000:0.0:1789427809.184805:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:1.0:1789427809.184831:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:0.0:1789427809.184831:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876350857129088:12345-192.168.201.55@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789427809.184837:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876350857129216:12345-192.168.201.55@tcp:8:mount.lustre.0 00000100:00100000:2.0:1789427809.184906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:2.0:1789427809.184913:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:8122:x1876350857129344:12345-192.168.201.55@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789427809.184987:0:5837:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789427809.185065:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:8122:x1876350857129344:12345-192.168.201.55@tcp:33:mount.lustre.0 Request processed in 151us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427809.185073:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 1 00010000:00080000:1.0:1789427809.185507:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6a378096-12fe-46c6-8e00-dd5f71de0c2d@192.168.201.55@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:1.0:1789427809.185544:0:6684:0:(genops.c:1384:class_connect()) connect: client 6a378096-12fe-46c6-8e00-dd5f71de0c2d, cookie 0x2bea1a57ca3433d1 00002000:00100000:1.0:1789427809.185557:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6a378096-12fe-46c6-8e00-dd5f71de0c2d/ffff933406ac8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789427809.185582:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789427809.185879:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789427809.186023:0:6684:0:(import.c:65:import_set_state_nolock()) ffff933406acd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789427809.186078:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:2353:x1876350857129216:12345-192.168.201.55@tcp:8:mount.lustre.0 Request processed in 1238us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427809.186088:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 13 00010000:00080000:0.0:1789427809.187622:0:8466:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6a378096-12fe-46c6-8e00-dd5f71de0c2d@192.168.201.55@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1789427809.187655:0:8466:0:(genops.c:1384:class_connect()) connect: client 6a378096-12fe-46c6-8e00-dd5f71de0c2d, cookie 0x2bea1a57ca3433d8 00002000:00100000:0.0:1789427809.187666:0:8466:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6a378096-12fe-46c6-8e00-dd5f71de0c2d/ffff933406019000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789427809.187686:0:8466:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789427809.188102:0:8466:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789427809.188130:0:8466:0:(import.c:65:import_set_state_nolock()) ffff933406019800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789427809.189466:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:2353:x1876350857129088:12345-192.168.201.55@tcp:8:mount.lustre.0 Request processed in 4643us (4876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427809.189479:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00010000:00010000:2.0:1789427809.482753:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427810.505732:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789427810.809622:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a378096-12fe-46c6-8e00-dd5f71de0c2d 00000100:00100000:3.0:1789427811.274394:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877084416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427811.274473:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427811.274548:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877084416 00000100:00100000:3.0:1789427811.274557:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877084416 00000100:00100000:3.0:1789427811.274609:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789427811.274627:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877084416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427811.274659:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427811.274700:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877084416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427811.274707:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789427811.274744:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343ae61f80 x1876350877084416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427811.274762:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877084416:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789427811.278896:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789427811.350923:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a378096-12fe-46c6-8e00-dd5f71de0c2d 00010000:00010000:0.0:1789427811.529341:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427812.297498:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877084544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427812.297579:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427812.297791:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877084544 00000100:00100000:0.0:1789427812.297801:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877084544 00000100:00100000:0.0:1789427812.297889:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789427812.297900:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877084544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427812.297936:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427812.297986:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877084544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427812.297995:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789427812.298020:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427812.300031:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877084672:0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.300100:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789427812.300235:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d924000 x1876350877084544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427812.300259:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877084544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427812.300376:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877084672 00000100:00100000:0.0:1789427812.300386:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877084672 00000100:00100000:0.0:1789427812.300426:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789427812.300436:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877084672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427812.300485:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877084672:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427812.300493:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789427812.300641:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877084672:0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.304298:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877084800:0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.304385:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427812.304431:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427812.304439:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877084928:0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.304467:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427812.304515:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877084800 00000100:00100000:3.0:1789427812.304531:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877084800 00000100:00100000:3.0:1789427812.304575:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877084928 00000100:00100000:3.0:1789427812.304578:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877084928 00000100:00100000:3.0:1789427812.304609:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789427812.304621:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877084800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.304679:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877084800:12345-0@lo:400:kworker.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427812.304686:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789427812.305158:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789427812.305166:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877084928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.305639:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877084928:12345-0@lo:400:kworker.0 Request processed in 472us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427812.305646:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789427812.305672:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427812.305955:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877084928:0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.305970:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877084800:0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.307190:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877085184:0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.307398:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427812.307447:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427812.307456:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877085056:0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.307480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427812.307509:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877085056 00000100:00100000:3.0:1789427812.307516:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877085056 00000100:00100000:3.0:1789427812.307559:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789427812.307568:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877085056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427812.307613:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877085056:12345-0@lo:400:kworker.0 Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427812.307628:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789427812.307669:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411bab100 x1876350877085056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427812.307681:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877085056:0@lo:400:kworker.0 00000100:00100000:0.0:1789427812.309565:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877085184 00000100:00100000:0.0:1789427812.309579:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877085184 00000100:00100000:0.0:1789427812.309642:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789427812.309770:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877085184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427812.309856:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877085184:12345-0@lo:400:kworker.0 Request processed in 196us (2448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427812.309864:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789427812.310336:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427812.310389:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877085184:0@lo:400:kworker.0 00000001:00100000:1.0:1789427812.373776:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a378096-12fe-46c6-8e00-dd5f71de0c2d 00010000:00010000:0.0:1789427812.553380:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427813.577757:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427814.366046:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427814.366108:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427814.366141:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427814.366169:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427814.366209:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427814.366243:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857129728 00000100:00100000:2.0:1789427814.366253:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857129728 00000100:00100000:0.0:1789427814.367482:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857129472 00000100:00100000:0.0:1789427814.367494:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857129472 00000100:00100000:0.0:1789427814.367550:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 220 00000100:00100000:0.0:1789427814.367564:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857129472:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427814.367643:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857129472:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 83us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427814.367662:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 220 00000100:00100000:0.0:1789427814.367699:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857129984 00000100:00100000:0.0:1789427814.367703:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857129984 00000100:00100000:0.0:1789427814.367731:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857129856 00000100:00100000:0.0:1789427814.367734:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857129856 00000100:00100000:0.0:1789427814.367753:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:0.0:1789427814.367759:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857129984:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427814.367785:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857129984:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 26us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427814.367792:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:0.0:1789427814.367802:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:0.0:1789427814.367808:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857129856:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427814.367828:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857129856:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 20us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427814.367834:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:2.0:1789427814.368225:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857129600 00000100:00100000:2.0:1789427814.368230:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857129600 00000100:00100000:2.0:1789427814.368257:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 66 00000100:00100000:2.0:1789427814.368264:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857129728:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427814.368383:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857129728:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 118us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427814.368390:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 66 00000100:00100000:2.0:1789427814.368411:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 67 00000100:00100000:2.0:1789427814.368417:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857129600:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427814.368441:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857129600:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 24us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427814.368446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 67 00000100:00080000:2.0:1789427814.375508:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427814.375519:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427814.375523:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789427814.610945:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789427814.676484:0:10310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789427815.625363:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427816.397881:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877085312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427816.397976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427816.398147:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877085312 00000100:00100000:2.0:1789427816.398157:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877085312 00000100:00100000:2.0:1789427816.398243:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789427816.398254:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877085312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427816.398306:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427816.398359:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877085312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427816.398367:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789427816.398393:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789427816.398427:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b6c0e00 x1876350877085312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427816.398519:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877085312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789427816.649460:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427817.420879:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877085440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427817.420975:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427817.421355:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877085440 00000100:00100000:3.0:1789427817.421366:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877085440 00000100:00100000:3.0:1789427817.421493:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789427817.421504:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877085440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427817.421552:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427817.421615:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877085440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427817.421622:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789427817.421799:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789427817.421915:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d926680 x1876350877085440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427817.421940:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877085440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427817.423079:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877085696:0@lo:400:kworker.0 00000100:00100000:1.0:1789427817.423150:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427817.423218:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789427817.423225:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877085568:0@lo:400:kworker.0 00000100:00100000:1.0:1789427817.423272:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427817.423300:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877086080:0@lo:400:kworker.0 00000100:00100000:1.0:1789427817.423324:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427817.423353:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877085568 00000100:00100000:1.0:1789427817.423372:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877085568 00000100:00100000:1.0:1789427817.423423:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789427817.423432:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877085568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427817.423486:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877085568:12345-0@lo:400:kworker.0 Request processed in 55us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427817.423493:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789427817.423546:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877085568:0@lo:400:kworker.0 00000100:00100000:0.0:1789427817.423815:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877085696 00000100:00100000:0.0:1789427817.423821:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877085696 00000100:00100000:0.0:1789427817.423851:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877086080 00000100:00100000:0.0:1789427817.423853:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877086080 00000100:00100000:0.0:1789427817.423879:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789427817.423886:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877085696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427817.423935:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877085696:12345-0@lo:400:kworker.0 Request processed in 49us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427817.423941:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789427817.423955:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789427817.423969:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877086080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427817.423999:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877086080:12345-0@lo:400:kworker.0 Request processed in 30us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427817.424005:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789427817.424038:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877086080:0@lo:400:kworker.0 00000100:00100000:0.0:1789427817.424048:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877085696:0@lo:400:kworker.0 00000100:00100000:2.0:1789427817.424762:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877085824:0@lo:400:kworker.0 00000100:00100000:2.0:1789427817.424831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427817.424871:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427817.424878:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877085952:0@lo:400:kworker.0 00000100:00100000:2.0:1789427817.424931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427817.424970:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877085952 00000100:00100000:2.0:1789427817.424977:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877085952 00000100:00100000:2.0:1789427817.425021:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789427817.425028:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877085952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427817.425074:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877085952:12345-0@lo:400:kworker.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427817.425082:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789427817.425107:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789427817.425134:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933411ba8700 x1876350877085952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427817.425148:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877085952:0@lo:400:kworker.0 00000100:00100000:0.0:1789427817.425388:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877085824 00000100:00100000:0.0:1789427817.425392:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877085824 00000100:00100000:0.0:1789427817.425429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789427817.425436:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877085824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427817.425474:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877085824:12345-0@lo:400:kworker.0 Request processed in 39us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427817.425479:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1789427817.426282:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427817.426322:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877085824:0@lo:400:kworker.0 00010000:00010000:3.0:1789427817.674037:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427818.697469:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427819.482746:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427819.482789:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427819.482823:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427819.482856:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427819.482907:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427819.482934:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857130624 00000100:00100000:2.0:1789427819.482938:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857130368 00000100:00100000:2.0:1789427819.482947:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857130368 00000100:00100000:1.0:1789427819.482948:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857130624 00000100:00100000:3.0:1789427819.483013:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857130240 00000100:00100000:3.0:1789427819.483018:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857130240 00000100:00100000:0.0:1789427819.483071:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857130112 00000100:00100000:0.0:1789427819.483075:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857130112 00000100:00100000:0.0:1789427819.483122:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 222 00000100:00100000:0.0:1789427819.483132:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857130112:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427819.483259:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857130112:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 128us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427819.483266:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 222 00000100:00100000:2.0:1789427819.483525:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 71 00000100:00100000:2.0:1789427819.483533:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857130368:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427819.483576:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857130368:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 45us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427819.483583:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 71 00000100:00100000:1.0:1789427819.488058:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857130496 00000100:00100000:1.0:1789427819.488079:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857130496 00000100:00100000:1.0:1789427819.488138:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:1.0:1789427819.488151:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857130624:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427819.488280:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857130624:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 130us (5455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427819.488290:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:1.0:1789427819.488315:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00100000:1.0:1789427819.488322:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857130496:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427819.488350:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857130496:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 29us (5443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427819.488357:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00100000:3.0:1789427819.491822:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 72 00000100:00100000:3.0:1789427819.491843:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857130240:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427819.491972:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857130240:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 135us (9114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427819.491980:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 72 00000100:00080000:2.0:1789427819.497036:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427819.497124:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427819.497131:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789427819.723896:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427820.746644:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427821.514288:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877086208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427821.514398:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427821.514678:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877086208 00000100:00100000:0.0:1789427821.514690:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877086208 00000100:00100000:0.0:1789427821.514765:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427821.514776:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877086208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427821.514826:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427821.514879:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877086208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427821.514887:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789427821.514911:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789427821.514949:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b900700 x1876350877086208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427821.514974:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877086208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789427821.770928:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427822.537664:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877086336:0@lo:400:kworker.0 00000100:00100000:1.0:1789427822.537679:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877086464:0@lo:400:kworker.0 00000100:00100000:0.0:1789427822.537741:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877086720:0@lo:400:kworker.0 00000100:00100000:3.0:1789427822.537775:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877086592:0@lo:400:kworker.0 00000100:00100000:2.0:1789427822.537869:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427822.537930:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877086848:0@lo:400:kworker.0 00000100:00100000:2.0:1789427822.537962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427822.538011:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877086848 00000100:00100000:2.0:1789427822.538021:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877086848 00000100:00100000:2.0:1789427822.538090:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789427822.538099:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877086848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427822.538161:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877086848:12345-0@lo:400:kworker.0 Request processed in 63us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427822.538198:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789427822.538244:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877086848:0@lo:400:kworker.0 00000100:00080000:2.0:1789427822.538286:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427822.538616:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877086336 00000100:00100000:2.0:1789427822.538622:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877086336 00000100:00100000:2.0:1789427822.538654:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789427822.538661:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877086336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427822.538725:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877086336:12345-0@lo:400:kworker.0 Request processed in 64us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427822.538731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789427822.538822:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877086336:0@lo:400:kworker.0 00000100:00100000:1.0:1789427822.539009:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427822.539048:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877086976:0@lo:400:kworker.0 00000100:00100000:1.0:1789427822.539079:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427822.539120:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877086976 00000100:00100000:1.0:1789427822.539124:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877086976 00000100:00100000:2.0:1789427822.539147:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877086464 00000100:00100000:2.0:1789427822.539151:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877086464 00000100:00100000:1.0:1789427822.539163:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789427822.539198:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877086976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427822.539216:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789427822.539223:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877086464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427822.539236:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877086976:12345-0@lo:400:kworker.0 Request processed in 40us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427822.539242:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789427822.539252:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877086464:12345-0@lo:400:kworker.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427822.539257:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789427822.539263:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427822.539281:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877086464:0@lo:400:kworker.0 00010000:00080000:1.0:1789427822.539294:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410060a80 x1876350877086976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427822.539304:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877086976:0@lo:400:kworker.0 00000100:00100000:0.0:1789427822.540890:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427822.540984:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427822.541048:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877087104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427822.541153:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427822.541198:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877087104 00000100:00100000:0.0:1789427822.541207:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877087104 00000100:00100000:0.0:1789427822.541257:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789427822.541265:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877087104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427822.541309:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427822.541357:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877087104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427822.541364:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789427822.541439:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877086720 00000100:00100000:1.0:1789427822.541444:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877086720 00000100:00100000:1.0:1789427822.541481:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789427822.541488:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877086720:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789427822.541517:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b902300 x1876350877087104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427822.541540:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877087104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427822.541544:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877086720:12345-0@lo:400:kworker.0 Request processed in 54us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427822.541553:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789427822.541601:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877086592 00010000:00080000:1.0:1789427822.541602:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410061180 x1876350877086720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427822.541607:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877086592 00000100:00100000:1.0:1789427822.541617:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877086720:0@lo:400:kworker.0 00000100:00100000:2.0:1789427822.541671:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789427822.541678:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877086592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427822.541724:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877086592:12345-0@lo:400:kworker.0 Request processed in 47us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427822.541730:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789427822.541779:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427822.541998:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877086592:0@lo:400:kworker.0 00010000:00010000:0.0:1789427822.793955:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427823.820536:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427824.610293:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427824.610344:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427824.610359:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857130752 00000100:00100000:2.0:1789427824.610371:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857130752 00000100:00100000:1.0:1789427824.610453:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427824.610455:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 224 00000100:00100000:2.0:1789427824.610468:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857130752:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427824.610787:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857130752:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 321us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427824.610796:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 224 00000100:00100000:1.0:1789427824.615306:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427824.615344:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427824.615379:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857131136 00000100:00100000:1.0:1789427824.615389:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857131136 00000100:00100000:1.0:1789427824.615443:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857131264 00000100:00100000:1.0:1789427824.615446:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857131264 00000100:00100000:1.0:1789427824.615463:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 40 00000100:00100000:1.0:1789427824.615472:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857131136:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427824.615537:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857131136:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 66us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427824.615545:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 40 00000100:00100000:1.0:1789427824.615560:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 41 00000100:00100000:1.0:1789427824.615566:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857131264:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427824.615584:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857131264:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 18us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427824.615590:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 41 00000100:00080000:1.0:1789427824.615624:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427824.615627:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427824.616005:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857130880 00000100:00100000:3.0:1789427824.616011:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857130880 00000100:00080000:1.0:1789427824.616116:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427824.617876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857131008 00000100:00100000:3.0:1789427824.617890:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857131008 00000100:00080000:1.0:1789427824.618001:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427824.618309:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 76 00000100:00100000:2.0:1789427824.618319:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857130880:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427824.618388:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857130880:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 71us (8045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427824.618393:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 76 00000100:00100000:2.0:1789427824.618405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 77 00000100:00100000:2.0:1789427824.618408:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857131008:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427824.618422:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857131008:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 14us (7974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427824.618426:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 77 00010000:00010000:3.0:1789427824.841688:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427825.865475:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427826.635882:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877087232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427826.635959:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427826.636042:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877087232 00000100:00100000:0.0:1789427826.636051:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877087232 00000100:00100000:0.0:1789427826.636116:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789427826.636126:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877087232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427826.636164:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427826.636229:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877087232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427826.636236:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789427826.636278:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410061880 x1876350877087232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427826.636297:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877087232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789427826.637384:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789427826.889330:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427827.658011:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877087488:0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658096:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427827.658148:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877088000:0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658201:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427827.658233:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789427827.658240:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877087360:0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658274:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427827.658297:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877087872:0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658318:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427827.658344:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877087744:0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658367:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427827.658386:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427827.658392:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877087616:0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427827.658442:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877087488 00000100:00100000:1.0:1789427827.658450:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877087488 00000100:00100000:1.0:1789427827.658494:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877087872 00000100:00100000:1.0:1789427827.658497:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877087872 00000100:00100000:1.0:1789427827.658520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877087616 00000100:00100000:1.0:1789427827.658523:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877087616 00000100:00100000:1.0:1789427827.658540:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789427827.658549:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877087488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658603:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877087488:12345-0@lo:400:kworker.0 Request processed in 55us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427827.658610:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789427827.658630:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789427827.658636:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877087872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658662:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877087872:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427827.658668:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789427827.658678:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789427827.658683:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877087616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658727:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877087616:12345-0@lo:400:kworker.0 Request processed in 43us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427827.658733:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789427827.658751:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877088000 00000100:00100000:1.0:1789427827.658754:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877088000 00000100:00100000:1.0:1789427827.658776:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877087744 00000100:00100000:1.0:1789427827.658778:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877087744 00000100:00100000:1.0:1789427827.658794:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789427827.658799:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877088000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.658828:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877088000:12345-0@lo:400:kworker.0 Request processed in 28us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427827.658834:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789427827.658995:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789427827.659001:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877087744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.659029:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877087744:12345-0@lo:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427827.659036:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789427827.659054:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877087360 00000100:00100000:1.0:1789427827.659058:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877087360 00000100:00100000:1.0:1789427827.659098:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789427827.659106:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877087360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.659135:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877087360:12345-0@lo:400:kworker.0 Request processed in 30us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427827.659141:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:1.0:1789427827.659171:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427827.659194:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427827.659232:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877087616:0@lo:400:kworker.0 00010000:00080000:1.0:1789427827.659255:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933406142d80 x1876350877087744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427827.659267:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877087744:0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.659295:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877087360:0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.659304:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877087872:0@lo:400:kworker.0 00000100:00100000:1.0:1789427827.659313:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877087488:0@lo:400:kworker.0 00010000:00080000:1.0:1789427827.659321:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933420e3ce00 x1876350877088000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427827.659330:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877088000:0@lo:400:kworker.0 00000100:00100000:3.0:1789427827.662343:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877088128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427827.662408:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427827.666428:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877088128 00000100:00100000:0.0:1789427827.666442:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877088128 00000100:00100000:0.0:1789427827.666500:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789427827.666510:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877088128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427827.666547:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427827.666702:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877088128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (4294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427827.666709:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789427827.666775:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d924e00 x1876350877088128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427827.666795:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877088128:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789427827.916136:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427828.937915:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427829.726170:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427829.726443:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427829.726471:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427829.726502:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427829.726581:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427829.726610:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857131776 00000100:00100000:2.0:1789427829.726619:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857131776 00000100:00100000:0.0:1789427829.726867:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857131520 00000100:00100000:0.0:1789427829.726872:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857131520 00000100:00100000:0.0:1789427829.726923:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857131648 00000100:00100000:0.0:1789427829.726926:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857131648 00000100:00100000:0.0:1789427829.726946:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 81 00000100:00100000:0.0:1789427829.726954:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857131520:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427829.727034:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857131520:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 81us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427829.727067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 81 00000100:00100000:0.0:1789427829.727087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 82 00000100:00100000:0.0:1789427829.727093:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857131648:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427829.727115:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857131648:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 23us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427829.727121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 82 00000100:00100000:2.0:1789427829.727568:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857131904 00000100:00100000:2.0:1789427829.727574:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857131904 00000100:00100000:2.0:1789427829.727598:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00100000:2.0:1789427829.727605:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2353:x1876350857131776:12345-192.168.201.55@tcp:9:kworker.0 00000020:00000080:2.0:1789427829.727626:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3433d8 00000100:00080000:2.0:1789427829.727753:0:6685:0:(import.c:65:import_set_state_nolock()) ffff933406019800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789427829.727791:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789427829.728110:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+2:2353:x1876350857131776:12345-192.168.201.55@tcp:9:kworker.0 Request processed in 503us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427829.728129:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00100000:2.0:1789427829.728145:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:2.0:1789427829.728151:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2353:x1876350857131904:12345-192.168.201.55@tcp:9:kworker.0 00000020:00000080:2.0:1789427829.728165:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3433d1 00000100:00080000:2.0:1789427829.728170:0:6685:0:(import.c:65:import_set_state_nolock()) ffff933406acd800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789427829.728435:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789427829.728808:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789427829.729047:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+2:2353:x1876350857131904:12345-192.168.201.55@tcp:9:kworker.0 Request processed in 882us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427829.729056:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:2.0:1789427829.729083:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857131392 00000100:00100000:2.0:1789427829.729089:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857131392 00000100:00100000:2.0:1789427829.729120:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 226 00000100:00100000:2.0:1789427829.729126:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857131392:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427829.729152:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857131392:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 25us (2650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427829.729158:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 226 00010000:00010000:3.0:1789427829.729364:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789427829.730436:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427829.730444:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427829.730447:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789427829.965744:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427830.985424:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427831.753556:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877088256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427831.753648:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427831.753736:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877088256 00000100:00100000:1.0:1789427831.753744:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877088256 00000100:00080000:3.0:1789427831.753807:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427831.753816:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789427831.753838:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877088256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427831.753876:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427831.753935:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877088256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427831.753943:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789427831.754037:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410060000 x1876350877088256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427831.754061:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877088256:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789427831.770499:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a378096-12fe-46c6-8e00-dd5f71de0c2d 00000020:00000080:3.0:1789427831.770508:0:7637:0:(genops.c:885:class_export_put()) final put ffff933406ac8800/6a378096-12fe-46c6-8e00-dd5f71de0c2d 00000020:00000080:0.0:1789427831.770618:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff933406ac8800/6a378096-12fe-46c6-8e00-dd5f71de0c2d for lustre-OST0001 00000020:00000080:0.0:1789427831.770785:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff933406acd800 for lustre-OST0001 00010000:00010000:3.0:1789427832.009358:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427832.778113:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877088384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427832.778217:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427832.778684:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877088384 00000100:00100000:3.0:1789427832.778694:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877088384 00000100:00080000:2.0:1789427832.778807:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427832.779245:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789427832.780199:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877088384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427832.780243:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427832.780610:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877088384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 439us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427832.780620:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789427832.780693:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d925c00 x1876350877088384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427832.780715:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877088384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427832.781282:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877088896:0@lo:400:kworker.0 00000100:00100000:3.0:1789427832.781369:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427832.781416:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877088512:0@lo:400:kworker.0 00000100:00100000:1.0:1789427832.781449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427832.781475:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877089024:0@lo:400:kworker.0 00000100:00100000:1.0:1789427832.781498:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427832.781527:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877088768:0@lo:400:kworker.0 00000100:00100000:1.0:1789427832.781547:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427832.781564:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427832.781570:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877088640:0@lo:400:kworker.0 00000100:00100000:1.0:1789427832.781590:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427832.781602:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877088896 00000100:00100000:0.0:1789427832.781611:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877088896 00000100:00100000:1.0:1789427832.781614:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877088512 00000100:00100000:1.0:1789427832.781617:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877088512 00000100:00100000:1.0:1789427832.781648:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789427832.781648:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789427832.781656:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877088512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427832.781656:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877088896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427832.781695:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877088512:12345-0@lo:400:kworker.0 Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427832.781695:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877088896:12345-0@lo:400:kworker.0 Request processed in 40us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427832.781702:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789427832.781702:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789427832.782458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877089024 00000100:00100000:1.0:1789427832.782466:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877089024 00000100:00100000:1.0:1789427832.782517:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877088768 00000100:00100000:1.0:1789427832.782521:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877088768 00000100:00100000:1.0:1789427832.782536:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877088640 00000100:00100000:1.0:1789427832.782538:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877088640 00000100:00100000:1.0:1789427832.782552:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789427832.782559:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877089024:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789427832.782572:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427832.782605:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877089024:12345-0@lo:400:kworker.0 Request processed in 46us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427832.782627:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789427832.782646:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789427832.782654:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877088768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427832.782701:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877088768:12345-0@lo:400:kworker.0 Request processed in 49us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427832.782707:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789427832.784073:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877088768:0@lo:400:kworker.0 00000100:00100000:0.0:1789427832.784644:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789427832.784659:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877088640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427832.784746:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877088640:12345-0@lo:400:kworker.0 Request processed in 93us (3154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427832.784882:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789427832.785097:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877088640:0@lo:400:kworker.0 00010000:00080000:2.0:1789427832.785266:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d926680 x1876350877088896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427832.785278:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877088896:0@lo:400:kworker.0 00000100:00100000:1.0:1789427832.785344:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877088512:0@lo:400:kworker.0 00000100:00100000:1.0:1789427832.785357:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877089024:0@lo:400:kworker.0 00000001:00100000:1.0:1789427832.882694:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a378096-12fe-46c6-8e00-dd5f71de0c2d 00000020:00000080:1.0:1789427832.882704:0:6710:0:(genops.c:885:class_export_put()) final put ffff933406019000/6a378096-12fe-46c6-8e00-dd5f71de0c2d 00000020:00000080:0.0:1789427832.882750:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff933406019000/6a378096-12fe-46c6-8e00-dd5f71de0c2d for lustre-OST0000 00000020:00000080:0.0:1789427832.882925:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff933406019800 for lustre-OST0000 00010000:00010000:3.0:1789427833.035971:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427834.057584:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427834.840989:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427834.841036:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427834.841063:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427834.841141:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857132032 00000100:00100000:0.0:1789427834.841153:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857132032 00000100:00100000:0.0:1789427834.841236:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 228 00000100:00100000:0.0:1789427834.841248:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857132032:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427834.841321:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857132032:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 75us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427834.841329:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 228 00000100:00100000:0.0:1789427834.841362:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857132288 00000100:00100000:0.0:1789427834.841365:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857132288 00000100:00100000:0.0:1789427834.841402:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857132160 00000100:00100000:0.0:1789427834.841405:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857132160 00000100:00100000:0.0:1789427834.841426:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 86 00000100:00100000:0.0:1789427834.841432:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857132288:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427834.841474:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857132288:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 41us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427834.841480:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 86 00000100:00100000:0.0:1789427834.841492:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 87 00000100:00100000:0.0:1789427834.841498:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857132160:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427834.841517:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857132160:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 19us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427834.841523:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 87 00000100:00080000:0.0:1789427834.841638:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789427835.085407:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789427835.134379:0:11016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789427836.106072:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427836.883781:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427836.889788:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877089152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427836.889931:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427836.890101:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877089152 00000100:00100000:2.0:1789427836.890112:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877089152 00000100:00100000:2.0:1789427836.890229:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789427836.890249:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877089152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427836.890302:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427836.890363:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877089152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427836.890371:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789427836.890671:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410062680 x1876350877089152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427836.890698:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877089152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789427836.890962:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789427837.135522:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427837.898277:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427837.898309:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877089280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427837.898416:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427837.898491:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877089664:0@lo:400:kworker.0 00000100:00100000:3.0:1789427837.898522:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427837.898551:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877089664 00000100:00100000:0.0:1789427837.898563:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877089664 00000100:00100000:3.0:1789427837.898564:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877089408:0@lo:400:kworker.0 00000100:00100000:3.0:1789427837.898598:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427837.898616:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427837.898621:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877089536:0@lo:400:kworker.0 00000100:00100000:0.0:1789427837.898628:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789427837.898639:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877089664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427837.898641:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427837.898675:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877089280 00000100:00100000:3.0:1789427837.898679:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877089280 00000100:00100000:0.0:1789427837.898703:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877089664:12345-0@lo:400:kworker.0 Request processed in 66us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427837.898711:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789427837.898711:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789427837.898717:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877089280:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427837.898728:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877089536 00000100:00100000:0.0:1789427837.898731:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877089536 00000100:00100000:0.0:1789427837.898750:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00002000:00000024:3.0:1789427837.898751:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427837.898754:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877089536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427837.898783:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877089280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427837.898784:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877089536:12345-0@lo:400:kworker.0 Request processed in 30us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427837.898789:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789427837.898790:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789427837.898834:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427837.898838:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427837.899064:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877089664:0@lo:400:kworker.0 00010000:00080000:3.0:1789427837.899079:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d924e00 x1876350877089280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427837.899094:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877089280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427837.899149:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877089536:0@lo:400:kworker.0 00000100:00100000:1.0:1789427837.899218:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877089408 00000100:00100000:1.0:1789427837.899224:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877089408 00000100:00100000:1.0:1789427837.899254:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789427837.899261:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877089408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427837.899306:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877089408:12345-0@lo:400:kworker.0 Request processed in 45us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427837.899312:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789427837.899331:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877089408:0@lo:400:kworker.0 00000100:00100000:3.0:1789427837.899676:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427837.899681:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427837.899685:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877089792:0@lo:400:kworker.0 00000100:00100000:2.0:1789427837.899689:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877089920:0@lo:400:kworker.0 00000100:00100000:3.0:1789427837.899719:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427837.899719:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427837.899819:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877089792 00000100:00100000:0.0:1789427837.899824:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877089792 00000100:00100000:0.0:1789427837.899863:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789427837.899870:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877089792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427837.899923:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877089792:12345-0@lo:400:kworker.0 Request processed in 54us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427837.899930:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789427837.899948:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877089920 00000100:00100000:0.0:1789427837.899951:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877089920 00010000:00080000:3.0:1789427837.899984:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410062300 x1876350877089792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427837.899990:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789427837.899995:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877089792:0@lo:400:kworker.0 00000100:00100000:0.0:1789427837.899997:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877089920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427837.900054:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877089920:12345-0@lo:400:kworker.0 Request processed in 57us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427837.900061:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789427837.900252:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877089920:0@lo:400:kworker.0 00000100:00080000:1.0:1789427837.900374:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789427838.153376:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427839.177477:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427839.960984:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427839.961059:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427839.961102:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427839.961157:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857132416 00000100:00100000:3.0:1789427839.961171:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857132416 00000100:00100000:0.0:1789427839.961219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857132544 00000100:00100000:0.0:1789427839.961226:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857132544 00000100:00100000:3.0:1789427839.961287:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 230 00000100:00100000:3.0:1789427839.961300:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857132416:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427839.961301:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857132672 00000100:00100000:0.0:1789427839.961305:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857132672 00000100:00100000:0.0:1789427839.961329:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 91 00000100:00100000:0.0:1789427839.961337:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857132544:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427839.961349:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 92 00000100:00100000:1.0:1789427839.961365:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857132672:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427839.961430:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2355:x1876350857132544:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 94us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427839.961438:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 91 00000100:00100000:3.0:1789427839.961489:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857132416:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 190us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427839.961498:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 230 00000100:00100000:1.0:1789427839.961864:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857132672:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 495us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427839.961872:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 92 00000100:00080000:2.0:1789427839.964072:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789427840.202170:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789427840.471067:0:11164:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3514fe70 20000000:00000080:3.0:1789427840.471093:0:11164:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff933411a95400 uarg=0000000000000000 20000000:01000000:3.0:1789427840.471143:0:11164:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789427840.471149:0:11164:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789427840.471154:0:11164:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789427840.476835:0:11165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789427840.477017:0:11164:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789427840.481606:0:11164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789427840.481650:0:11164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.481675:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a865b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.481686:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34338b expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.481693:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343399 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.481700:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3433a7 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.482048:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8693 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.482056:0:11164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.482111:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8693 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.482130:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8693 expref: 12 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427840.482149:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090048:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427840.482515:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3433a7 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.482526:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3433a7 expref: 18 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427840.482538:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090176:0@lo:104: 00000100:00100000:0.0:1789427840.482594:0:11164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427840.482676:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343399 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.482684:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343399 expref: 18 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427840.482692:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090304:0@lo:104: 00000100:00100000:0.0:1789427840.482723:0:11164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427840.482913:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877090176 00000100:00100000:3.0:1789427840.482929:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877090176 00000100:00100000:3.0:1789427840.482980:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877090304 00000100:00100000:3.0:1789427840.482983:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877090304 00000100:00100000:3.0:1789427840.483000:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789427840.483010:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:11164:x1876350877090176:12345-0@lo:104: 00010000:00010000:3.0:1789427840.483025:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.483093:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789427840.483101:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+4:11164:x1876350877090176:12345-0@lo:104: Request processed in 91us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427840.483108:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789427840.483127:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789427840.483134:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11164:x1876350877090304:12345-0@lo:104: 00010000:00010000:3.0:1789427840.483141:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.483207:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789427840.483213:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11164:x1876350877090304:12345-0@lo:104: Request processed in 80us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427840.483219:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789427840.483237:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789427840.483245:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.483255:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401527c00 already unused, calling callback (ffffffffc1e08c20) 00010000:00010000:1.0:1789427840.483257:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1789427840.483260:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.483272:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.483286:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179c00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427840.483290:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.483310:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.483311:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427840.483330:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789427840.483331:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427840.483349:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789427840.483350:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427840.483544:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34338b expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.483556:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34338b expref: 18 pid: 5829 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.483559:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427840.483571:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090432:0@lo:104: 00010000:00010000:1.0:1789427840.483572:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427840.483600:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427840.483606:0:11164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789427840.483615:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e179c00/0x2bea1a57ca343399 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3433a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.483630:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427840.483633:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427840.483635:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427840.483643:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a865b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.483653:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a865b expref: 12 pid: 5827 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427840.483663:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090688:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427840.483759:0:11164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e1adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427840.483785:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090176:0@lo:104: 00000100:00100000:0.0:1789427840.483794:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090304:0@lo:104: 00010000:00010000:3.0:1789427840.483975:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.483982:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789427840.484002:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.484009:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401527c00/0x2bea1a57ca3433a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3433ae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.484023:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427840.484025:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427840.484028:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427840.484043:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877090816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427840.484051:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090048:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427840.484081:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427840.484122:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877090432 00000100:00100000:3.0:1789427840.484127:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877090432 00000100:00100000:3.0:1789427840.484155:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789427840.484161:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11164:x1876350877090432:12345-0@lo:104: 00000100:00100000:0.0:1789427840.484241:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877090816 00010000:00010000:3.0:1789427840.484244:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427840.484246:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877090816 00010000:00010000:0.0:1789427840.484269:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3433a7 expref: 19 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427840.484279:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877090560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427840.484291:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789427840.484298:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877090816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427840.484308:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789427840.484319:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789427840.484322:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3433a7 expref: 19 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.484334:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3433a7 expref: 19 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.484360:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02b000/0x2bea1a57ca3433ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3433a7 expref: 19 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.484370:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789427840.484374:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427840.484379:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11164:x1876350877090432:12345-0@lo:104: Request processed in 216us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427840.484387:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789427840.484412:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3298:x1876350877090816:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427840.484416:0:5821:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789427840.484422:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789427840.484426:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789427840.484446:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427840.484452:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.484461:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401527600 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:3.0:1789427840.484465:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427840.484467:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877090560 00000100:00100000:0.0:1789427840.484473:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877090560 00010000:00010000:3.0:1789427840.484477:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789427840.484487:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.484488:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343399 expref: 18 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427840.484502:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789427840.484515:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789427840.484523:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3301:x1876350877090560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427840.484527:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.484532:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427840.484535:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427840.484539:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343399 expref: 18 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.484545:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.484552:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343399 expref: 18 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.484556:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401527600/0x2bea1a57ca34338b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343392 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.484566:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7a00/0x2bea1a57ca3433a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343399 expref: 18 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.484585:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427840.484591:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427840.484595:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427840.484597:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427840.484615:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877090944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427840.484619:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877090816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427840.484629:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:3301:x1876350877090560:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427840.484637:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789427840.484664:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427840.484668:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090432:0@lo:104: 00000100:00100000:1.0:1789427840.484709:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877090560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427840.484732:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877090944 00000100:00100000:1.0:1789427840.484737:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877090944 00010000:00010000:1.0:1789427840.484754:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34338b expref: 17 pid: 5829 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427840.484769:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789427840.484775:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:3299:x1876350877090944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427840.484781:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427840.484783:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34338b expref: 17 pid: 5829 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.484789:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34338b expref: 17 pid: 5829 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.484797:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e178600/0x2bea1a57ca343392 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34338b expref: 17 pid: 5829 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.484803:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427840.484833:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3299:x1876350877090944:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427840.484838:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789427840.484870:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877090944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789427840.488249:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427840.488279:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857132800 00000100:00100000:1.0:1789427840.488290:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857132800 00000100:00100000:2.0:1789427840.488315:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00010000:00010000:1.0:1789427840.488334:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8693 expref: 13 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427840.488361:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876350877090688:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427840.488375:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857132928 00000100:00100000:3.0:1789427840.488381:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857132928 00010000:00010000:3.0:1789427840.488403:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a865b expref: 14 pid: 5827 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.488417:0:11164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427840.488435:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 28 00000100:00100000:3.0:1789427840.488446:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410061180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+14:2356:x1876350857132800:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427840.488465:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427840.488472:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8693 expref: 14 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.488484:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8693 expref: 14 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.488503:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02aa00/0x2bea1a57ca3433c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8693 expref: 14 pid: 5828 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427840.488517:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427840.488590:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:1.0:1789427840.488617:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857132928:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427840.488626:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427840.488632:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a865b expref: 13 pid: 5827 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488642:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a865b expref: 13 pid: 5827 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488654:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7e00/0x2bea1a57ca343384 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a865b expref: 13 pid: 5827 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488668:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488679:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488707:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488716:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488724:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488732:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488740:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179000 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789427840.488744:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488760:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488781:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427840.488791:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427840.488905:0:11164:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.488915:0:11164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427840.488923:0:11164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e179000/0x2bea1a57ca3433df lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427840.488955:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:2357:x1876350857132928:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 336us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427840.488965:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:3.0:1789427840.489786:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410061180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:2356:x1876350857132800:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 507us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427840.489796:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 28 00010000:00010000:2.0:1789427841.227918:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427841.496947:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427841.499211:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857133056 00000100:00100000:2.0:1789427841.499227:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857133056 00000100:00100000:2.0:1789427841.499385:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 231 00000100:00100000:2.0:1789427841.499398:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:5595:x1876350857133056:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427841.499416:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427841.499438:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a86bd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.499468:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86bd expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.499497:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86bd expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.499507:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02ae00, rc 0) 00000100:00100000:2.0:1789427841.499600:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857133056:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 Request processed in 204us (2660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427841.499607:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 231 00000100:00100000:0.0:1789427841.507958:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427841.508074:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857133184 00000100:00100000:3.0:1789427841.508085:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857133184 00000100:00100000:3.0:1789427841.508149:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 232 00000100:00100000:3.0:1789427841.508160:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857133184:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427841.508841:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857133184:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 Request processed in 680us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427841.508850:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 232 00000100:00100000:1.0:1789427841.513048:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427841.513153:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857133312 00000100:00100000:2.0:1789427841.513165:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857133312 00000100:00100000:2.0:1789427841.513249:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 233 00000100:00100000:2.0:1789427841.513260:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857133312:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.513528:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857133312:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 Request processed in 269us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427841.513537:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 233 00000100:00100000:0.0:1789427841.521213:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427841.521650:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857133440 00000100:00100000:3.0:1789427841.521662:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857133440 00000100:00100000:3.0:1789427841.521733:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 234 00000100:00100000:3.0:1789427841.521744:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857133440:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427841.521762:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427841.521783:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a86c4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427841.521814:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86c4 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427841.521838:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86c4 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427841.521848:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527600, rc 0) 00000100:00100000:3.0:1789427841.521913:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857133440:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 Request processed in 171us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427841.521921:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 234 00000100:00100000:0.0:1789427841.523847:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427841.523938:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857133568 00000100:00100000:1.0:1789427841.523947:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857133568 00000100:00100000:1.0:1789427841.524009:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 235 00000100:00100000:1.0:1789427841.524019:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857133568:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427841.524660:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857133568:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 Request processed in 639us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427841.524669:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 235 00000100:00100000:1.0:1789427841.528910:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427841.529024:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857133696 00000100:00100000:2.0:1789427841.529036:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857133696 00000100:00100000:2.0:1789427841.529096:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 236 00000100:00100000:2.0:1789427841.529108:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857133696:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.529787:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857133696:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 Request processed in 678us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427841.529798:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 236 10000000:01000000:1.0:1789427841.737334:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789427841.737342:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93341d0db000 from 7 10000000:01000000:1.0:1789427841.737347:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427841.737407:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427841.737431:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427841.737463:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427841.737492:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789427841.737693:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427841.737757:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93343a8c5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427841.737844:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877091072 00000100:00100000:3.0:1789427841.737855:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877091072 00000100:00100000:3.0:1789427841.737923:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789427841.737933:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877091072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427841.737948:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427841.737961:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3433f4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427841.737988:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3433f4 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427841.738000:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3433f4 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427841.738009:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527c00, rc 0) 00000100:00100000:3.0:1789427841.738065:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877091072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427841.738072:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789427841.738350:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427841.738367:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.738389:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427841.738449:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.738479:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.738507:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427841.738523:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877091200 00000100:00100000:0.0:1789427841.738528:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877091200 00000100:00100000:0.0:1789427841.738606:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789427841.738613:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877091200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427841.738856:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877091200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427841.738865:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789427841.738888:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.738922:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.738963:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.738985:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427841.739016:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877091328 00000100:00100000:1.0:1789427841.739022:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877091328 00000100:00100000:1.0:1789427841.739052:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789427841.739060:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877091328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427841.739327:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877091328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427841.739334:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789427841.739417:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789427841.740662:0:11186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789427841.740829:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789427841.740846:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427841.740857:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.740869:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427841.740880:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789427841.740883:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933406156800 from 7 10000000:01000000:2.0:1789427841.740885:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789427841.740924:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.740932:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.740952:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427841.740971:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.741017:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.741056:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427841.741117:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877091456 00000100:00100000:0.0:1789427841.741123:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877091456 00000100:00100000:0.0:1789427841.741156:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789427841.741163:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877091456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427841.741171:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427841.741200:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343402 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427841.741218:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343402 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427841.741225:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343402 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427841.741230:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179800, rc 0) 00000100:00100000:0.0:1789427841.741256:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877091456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427841.741260:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789427841.741363:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427841.741376:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.741394:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427841.741508:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.741658:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.741687:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427841.741798:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877091584 00000100:00100000:1.0:1789427841.741803:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877091584 00000100:00100000:1.0:1789427841.741839:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789427841.741847:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877091584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427841.742060:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877091584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427841.742067:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789427841.742265:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.742293:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.742339:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.742361:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427841.742379:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877091712 00000100:00100000:3.0:1789427841.742386:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877091712 00000100:00100000:3.0:1789427841.742422:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789427841.742428:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877091712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427841.742567:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877091712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427841.742574:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789427841.742876:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789427841.744740:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789427841.744914:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789427841.744933:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427841.744944:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.744973:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427841.744984:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789427841.744987:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933433d9c800 from 7 10000000:01000000:2.0:1789427841.744989:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789427841.745024:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.745032:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.745042:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427841.745064:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.745119:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.745160:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427841.745284:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877091840 00000100:00100000:1.0:1789427841.745291:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877091840 00000100:00100000:1.0:1789427841.745610:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789427841.745622:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877091840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427841.745635:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427841.745646:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343410 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427841.745669:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343410 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427841.745681:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343410 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427841.745690:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7000, rc 0) 00000100:00100000:1.0:1789427841.745777:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877091840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427841.745784:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789427841.746663:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427841.746681:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.746692:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427841.746746:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.746771:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.746805:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427841.746835:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877091968 00000100:00100000:0.0:1789427841.746845:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877091968 00000100:00100000:0.0:1789427841.746878:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789427841.746886:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877091968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427841.747131:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877091968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427841.747138:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789427841.747219:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877091968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.747244:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877092096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427841.747282:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.747308:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427841.747390:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877092096 00000100:00100000:1.0:1789427841.747396:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877092096 00000100:00100000:1.0:1789427841.747486:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789427841.747494:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877092096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427841.747719:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877092096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427841.747726:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789427841.747808:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877092096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789427841.748995:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789427841.749142:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789427841.749158:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427841.749168:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427841.749212:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427841.993609:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427841.993635:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877092224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427841.993707:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427841.994011:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877092224 00000100:00100000:2.0:1789427841.994021:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877092224 00000100:00100000:2.0:1789427841.994119:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789427841.994128:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877092224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427841.994162:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427841.994227:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877092224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427841.994235:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789427841.994274:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410063100 x1876350877092224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427841.994293:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877092224:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789427841.995062:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789427842.249542:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427843.017425:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877092736:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.017516:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427843.017576:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789427843.017583:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877092352:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.017612:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427843.017648:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877092864:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.017672:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427843.017700:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877092480:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.017721:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427843.017738:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877092992:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.017768:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427843.017793:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427843.017809:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877092608:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.017831:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427843.017863:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877092736 00000100:00100000:2.0:1789427843.017871:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877092736 00000100:00100000:2.0:1789427843.017923:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877092992 00000100:00100000:2.0:1789427843.017926:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877092992 00000100:00100000:2.0:1789427843.017948:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789427843.017957:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877092736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.018006:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877092736:12345-0@lo:400:kworker.0 Request processed in 50us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427843.018013:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789427843.018028:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789427843.018034:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877092992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.018060:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877092992:12345-0@lo:400:kworker.0 Request processed in 27us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427843.018073:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789427843.018088:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877092352 00000100:00100000:2.0:1789427843.018091:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877092352 00000100:00100000:2.0:1789427843.018110:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789427843.018115:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877092352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.018141:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877092352:12345-0@lo:400:kworker.0 Request processed in 25us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427843.018146:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789427843.018167:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877092864 00000100:00100000:2.0:1789427843.018170:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877092864 00000100:00100000:2.0:1789427843.018728:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877092480 00000100:00100000:2.0:1789427843.018735:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877092480 00000100:00100000:2.0:1789427843.018748:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877092608 00000100:00100000:2.0:1789427843.018751:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877092608 00000100:00100000:2.0:1789427843.018765:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789427843.018782:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877092864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.018830:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877092864:12345-0@lo:400:kworker.0 Request processed in 49us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427843.018837:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789427843.018848:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789427843.018853:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877092480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.018879:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877092480:12345-0@lo:400:kworker.0 Request processed in 26us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427843.018884:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789427843.018897:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789427843.018902:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877092608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.018938:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877092608:12345-0@lo:400:kworker.0 Request processed in 36us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427843.018943:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1789427843.018971:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427843.018976:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427843.018978:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427843.019021:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877092608:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.019031:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877092480:0@lo:400:kworker.0 00010000:00080000:2.0:1789427843.019042:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410060000 x1876350877092992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427843.019051:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877092992:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.019082:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877092352:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.019091:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877092864:0@lo:400:kworker.0 00010000:00080000:2.0:1789427843.019101:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410062680 x1876350877092736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427843.019115:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877092736:0@lo:400:kworker.0 00000100:00100000:2.0:1789427843.019530:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877093120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427843.019567:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427843.019599:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877093120 00000100:00100000:2.0:1789427843.019603:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877093120 00000100:00100000:2.0:1789427843.020561:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789427843.020577:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877093120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427843.020616:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427843.020697:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877093120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427843.020705:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789427843.020752:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933441bcca80 x1876350877093120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427843.020973:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877093120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789427843.275429:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789427843.689621:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789427844.297460:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427845.080461:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427845.080520:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427845.080572:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427845.080626:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857134080 00000100:00100000:2.0:1789427845.080646:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857134080 00000100:00100000:3.0:1789427845.080679:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857133952 00000100:00100000:3.0:1789427845.080701:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857133952 00000100:00100000:2.0:1789427845.080756:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 96 00000100:00100000:2.0:1789427845.080789:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857134080:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427845.080790:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 97 00000100:00100000:3.0:1789427845.080811:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857133952:12345-192.168.201.55@tcp:400:kworker.0 00000100:00080000:0.0:1789427845.080943:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427845.080975:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857133824 00000100:00100000:1.0:1789427845.080983:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857133824 00000100:00100000:3.0:1789427845.086989:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857133952:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 6173us (6403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427845.087005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 97 00000100:00100000:1.0:1789427845.088933:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 247 00000100:00100000:1.0:1789427845.088949:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857133824:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427845.092969:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857134080:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 12173us (12428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427845.094257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 96 00000100:00100000:1.0:1789427845.095259:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857133824:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 6300us (14796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427845.095275:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 247 00010000:00010000:2.0:1789427845.321810:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427846.347855:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427847.113829:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877093248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427847.113943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427847.114134:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877093248 00000100:00100000:3.0:1789427847.114147:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877093248 00000100:00100000:3.0:1789427847.114259:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789427847.114271:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877093248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427847.114318:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789427847.114439:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427847.114543:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877093248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 273us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427847.114551:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789427847.114623:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b5fca80 x1876350877093248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427847.114644:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877093248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789427847.371060:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427848.137350:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427848.137375:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877093376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427848.137446:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427848.137522:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877093376 00000100:00100000:2.0:1789427848.137537:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877093376 00000100:00100000:2.0:1789427848.137593:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789427848.137602:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877093376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427848.137636:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427848.137680:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877093376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.137688:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789427848.137722:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789427848.137755:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341de77800 x1876350877093376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427848.137775:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877093376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427848.139154:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877093888:0@lo:400:kworker.0 00000100:00100000:3.0:1789427848.139234:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427848.139266:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427848.139273:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877093760:0@lo:400:kworker.0 00000100:00100000:3.0:1789427848.139298:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427848.139339:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877093504:0@lo:400:kworker.0 00000100:00100000:3.0:1789427848.139368:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427848.139394:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877094016:0@lo:400:kworker.0 00000100:00100000:3.0:1789427848.139476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427848.139497:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427848.139502:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877093632:0@lo:400:kworker.0 00000100:00100000:3.0:1789427848.139638:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427848.139669:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877093888 00000100:00100000:3.0:1789427848.139676:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877093888 00000100:00100000:3.0:1789427848.139740:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789427848.139749:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877093888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427848.141274:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877093760 00000100:00100000:2.0:1789427848.141288:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877093760 00000100:00100000:2.0:1789427848.141334:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877094016 00000100:00100000:2.0:1789427848.141337:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877094016 00000100:00100000:2.0:1789427848.141352:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877093632 00000100:00100000:2.0:1789427848.141355:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877093632 00000100:00100000:2.0:1789427848.141369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789427848.141377:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877093760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427848.141445:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877093760:12345-0@lo:400:kworker.0 Request processed in 69us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.141453:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789427848.141469:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789427848.141475:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877094016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427848.141508:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877094016:12345-0@lo:400:kworker.0 Request processed in 33us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.141514:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789427848.141537:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789427848.141543:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877093632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427848.141571:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877093632:12345-0@lo:400:kworker.0 Request processed in 29us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.141577:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789427848.141596:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877093504 00000100:00100000:2.0:1789427848.141599:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877093504 00000100:00100000:2.0:1789427848.141624:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789427848.141630:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877093504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427848.141670:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877093504:12345-0@lo:400:kworker.0 Request processed in 40us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.141676:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:2.0:1789427848.141717:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427848.142287:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877093888:12345-0@lo:400:kworker.0 Request processed in 48us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427848.142297:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789427848.142443:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877093760:0@lo:400:kworker.0 00010000:00080000:3.0:1789427848.142460:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b5fc700 x1876350877093888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427848.142472:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877093888:0@lo:400:kworker.0 00000100:00100000:3.0:1789427848.142507:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877093632:0@lo:400:kworker.0 00000100:00100000:3.0:1789427848.142518:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877093504:0@lo:400:kworker.0 00000100:00100000:3.0:1789427848.142530:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877094016:0@lo:400:kworker.0 00000001:02000400:3.0:1789427848.251010:0:11464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:17:26 (1789427846) === 00010000:00010000:0.0:1789427848.393424:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427848.532290:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.532603:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857134208 00000100:00100000:2.0:1789427848.532615:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857134208 00000100:00100000:2.0:1789427848.532728:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00100000:2.0:1789427848.532741:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857134208:12345-192.168.201.55@tcp:41:mkdir.0 00000004:00000024:2.0:1789427848.532791:0:5834:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789427848.532890:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857134208:12345-192.168.201.55@tcp:41:mkdir.0 Request processed in 151us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.532897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00080000:0.0:1789427848.533920:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427848.534994:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427848.535269:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857134336 00000100:00100000:1.0:1789427848.535286:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857134336 00000100:00100000:1.0:1789427848.535364:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:1.0:1789427848.535375:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:691432fe-93d9-4afe-b1ac-013e2024784c+6:9675:x1876350857134336:12345-192.168.201.55@tcp:700:mkdir.0 00000100:00100000:1.0:1789427848.535475:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:691432fe-93d9-4afe-b1ac-013e2024784c+6:9675:x1876350857134336:12345-192.168.201.55@tcp:700:mkdir.0 Request processed in 101us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427848.535482:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:1.0:1789427848.539106:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.539265:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857134592 00000100:00100000:2.0:1789427848.539282:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857134592 00000100:00100000:2.0:1789427848.539454:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:2.0:1789427848.539467:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:9675:x1876350857134592:12345-192.168.201.55@tcp:36:mkdir.0 00010000:00010000:2.0:1789427848.539538:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427848.539635:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3432ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8646 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.539658:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083ca500) 00010000:00010000:2.0:1789427848.539670:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427848.540042:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.540057:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.540068:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.542278:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.542553:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.542569:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427848.545882:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789427848.545903:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.545913:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.545921:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.545937:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02bc00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427848.545942:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.545951:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.545971:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215b000) 00010000:00010000:2.0:1789427848.545975:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427848.545980:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.545986:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34341e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427848.546009:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000394c3b75 reply state 000000009f09735d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427848.546019:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427848.546448:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:9675:x1876350857134592:12345-192.168.201.55@tcp:36:mkdir.0 Request processed in 6979us (7350us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789427848.546458:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 15 00010000:00010000:2.0:1789427848.552772:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.552794:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.552802:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.552820:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02aa00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427848.552826:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.552835:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.552853:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93342215ba00) 00010000:00010000:2.0:1789427848.552856:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427848.552862:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.552868:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343425 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427848.572550:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427848.572672:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857134720 00000100:00100000:3.0:1789427848.572691:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857134720 00000100:00100000:3.0:1789427848.572927:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:3.0:1789427848.572943:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:9676:x1876350857134720:12345-192.168.201.55@tcp:101:chmod.0 00010000:00010000:3.0:1789427848.572975:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427848.573011:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34342c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a86cb expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.573105:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401527e00/0x2bea1a57ca343433 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.573123:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401527e00/0x2bea1a57ca343433 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.573161:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401527e00/0x2bea1a57ca343433 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427848.573258:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789427848.573263:0:8694:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789427848.573311:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933401527e00/0x2bea1a57ca343433 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.573343:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34342c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86cb expref: 8 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.573366:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401527e00/0x2bea1a57ca343433 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86cb expref: 7 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.573375:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:3.0:1789427848.573378:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427848.573382:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527e00, rc 0) 00000100:00100000:3.0:1789427848.573469:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:9676:x1876350857134720:12345-192.168.201.55@tcp:101:chmod.0 Request processed in 531us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427848.573477:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:0.0:1789427848.585461:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427848.585632:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857134976 00000100:00100000:3.0:1789427848.585648:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857134976 00000100:00100000:3.0:1789427848.586383:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:3.0:1789427848.586400:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:9676:x1876350857134976:12345-192.168.201.55@tcp:36:chmod.0 00010000:00010000:3.0:1789427848.586483:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427848.586517:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401527e00/0x2bea1a57ca343433 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86cb expref: 7 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.586565:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:3.0:1789427848.586590:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427848.586625:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.586641:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.586654:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427848.588171:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cdd8e6b8 reply state 0000000071877b5d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427848.589041:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789427848.589058:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789427848.589410:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+8:9676:x1876350857134976:12345-192.168.201.55@tcp:36:chmod.0 Request processed in 3009us (3960us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789427848.589421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 17 00010000:00010000:1.0:1789427848.594146:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427848.594372:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427848.594384:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427848.594392:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401527200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427848.594398:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427848.594432:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427848.594455:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933410b41400) 00010000:00010000:1.0:1789427848.594459:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789427848.594466:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427848.594472:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34343a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427848.611306:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.612969:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857135104 00000100:00100000:2.0:1789427848.612993:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857135104 00000100:00100000:2.0:1789427848.613093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 18 00000100:00100000:2.0:1789427848.613105:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:9677:x1876350857135104:12345-192.168.201.55@tcp:101:chown.0 00010000:00010000:2.0:1789427848.613144:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427848.613237:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a86d2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.613348:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343448 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.613366:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.613381:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427848.613461:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789427848.613466:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427848.613525:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.613557:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca343441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86d2 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.613594:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343448 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86d2 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.613604:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215ba00) 00010000:00010000:2.0:1789427848.615368:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427848.615378:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02bc00, rc 0) 00000100:00100000:2.0:1789427848.615521:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:9677:x1876350857135104:12345-192.168.201.55@tcp:101:chown.0 Request processed in 2411us (4223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.615532:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 18 00000100:00100000:0.0:1789427848.628025:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.628471:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857135232 00000100:00100000:2.0:1789427848.629137:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857135232 00000100:00100000:2.0:1789427848.630155:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:2.0:1789427848.630203:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+8:9677:x1876350857135232:12345-192.168.201.55@tcp:101:chown.0 00010000:00010000:2.0:1789427848.630235:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427848.630263:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca34344f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a86d9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630359:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630413:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630429:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630452:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630460:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630466:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630589:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630596:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630601:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427848.630638:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789427848.630641:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427848.630664:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630678:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.630695:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631231:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631239:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427848.631244:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631254:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631268:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215ba00) 00010000:00010000:2.0:1789427848.631280:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427848.631286:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631293:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631310:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631316:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631323:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631328:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02b200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427848.631340:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631347:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631354:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93342215b000) 00010000:00010000:2.0:1789427848.631357:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427848.631359:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631365:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34345d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631422:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca34344f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86d9 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631438:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86d9 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.631447:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93342215bd00) 00010000:00010000:2.0:1789427848.631449:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427848.631452:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401491c00, rc 0) 00000100:00100000:2.0:1789427848.631940:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+9:9677:x1876350857135232:12345-192.168.201.55@tcp:101:chown.0 Request processed in 1767us (3925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.631952:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:1.0:1789427848.638938:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.639134:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857135488 00000100:00100000:2.0:1789427848.639147:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857135488 00000100:00100000:2.0:1789427848.639377:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:2.0:1789427848.639390:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:9677:x1876350857135488:12345-192.168.201.55@tcp:36:chown.0 00010000:00010000:2.0:1789427848.639820:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427848.639858:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86d9 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.639883:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93342215bd00) 00010000:00010000:2.0:1789427848.639897:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427848.639932:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.639948:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.639961:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427848.703446:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1789427848.703615:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003c96a962 reply state 00000000ded76ae9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427848.703634:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789427848.703654:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1789427848.703803:0:5834:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789427848.703825:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:9677:x1876350857135488:12345-192.168.201.55@tcp:36:chown.0 Request processed in 64430us (64898us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789427848.703836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 20 00010000:00010000:2.0:1789427848.703980:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.703992:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.704002:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.704009:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401490a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427848.704015:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.704024:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.704067:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93342215be00) 00010000:00010000:2.0:1789427848.704071:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789427848.704078:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.704085:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca34346b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427848.728460:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427848.728816:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857135616 00000100:00100000:3.0:1789427848.728851:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857135616 00000100:00100000:3.0:1789427848.728923:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00100000:3.0:1789427848.728933:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:9678:x1876350857135616:12345-192.168.201.55@tcp:101:touch.500 00010000:00010000:3.0:1789427848.728970:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427848.728999:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401527e00/0x2bea1a57ca343472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a86e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427848.730341:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1274us 00010000:00010000:3.0:1789427848.744418:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.744447:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.744458:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.744471:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.744475:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.744480:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745467:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401527400/0x2bea1a57ca343487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745485:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401527400/0x2bea1a57ca343487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745508:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401527400/0x2bea1a57ca343487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427848.745541:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789427848.745546:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789427848.745593:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933401527400/0x2bea1a57ca343487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745618:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745625:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745633:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745640:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401526200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427848.745645:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745654:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745668:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215ba00) 00010000:00010000:3.0:1789427848.745671:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427848.745676:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745683:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401526200/0x2bea1a57ca343479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745721:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745728:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745734:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745740:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401526600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427848.745743:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745749:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745758:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff933410b41f00) 00010000:00010000:3.0:1789427848.745761:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427848.745764:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745769:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401526600/0x2bea1a57ca343480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745817:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401527e00/0x2bea1a57ca343472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86e0 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745833:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401527400/0x2bea1a57ca343487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86e0 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.745851:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:3.0:1789427848.745854:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789427848.745856:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401527400, rc 0) 00000100:00100000:3.0:1789427848.745965:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:9678:x1876350857135616:12345-192.168.201.55@tcp:101:touch.500 Request processed in 17030us (17517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427848.745975:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00100000:0.0:1789427848.750808:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427848.751154:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857135872 00000100:00100000:3.0:1789427848.751168:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857135872 00000100:00100000:3.0:1789427848.751286:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:3.0:1789427848.751301:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:9678:x1876350857135872:12345-192.168.201.55@tcp:101:touch.500 00010000:00010000:3.0:1789427848.751330:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427848.751360:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34348e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a86e7 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.751749:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.751768:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.751781:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.752065:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.752094:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.752128:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427848.753358:0:8694:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789427848.753652:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3434a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753667:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3434a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753679:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3434a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753727:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753734:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753741:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753747:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427848.753752:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753760:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753773:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:3.0:1789427848.753776:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427848.753789:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753795:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343495 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427848.753808:0:8694:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002642dc2e reply state 00000000f3f1c674 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427848.753817:0:8694:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789427848.753852:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401527200/0x2bea1a57ca34348e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86e7 expref: 10 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.753866:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3434a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86e7 expref: 9 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.755079:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933410b41700) 00010000:00010000:3.0:1789427848.755083:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427848.755085:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031e00, rc 0) 00000100:00100000:3.0:1789427848.755162:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+10:9678:x1876350857135872:12345-192.168.201.55@tcp:101:touch.500 Request processed in 3863us (4364us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789427848.755171:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 22 00010000:00010000:2.0:1789427848.757064:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.757085:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.757094:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.757101:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427848.757107:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.757115:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.757133:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff933410b41200) 00010000:00010000:2.0:1789427848.757137:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427848.757143:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.757150:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34349c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427848.759358:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.766441:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857136128 00000100:00100000:2.0:1789427848.766466:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857136128 00000100:00100000:2.0:1789427848.768045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 23 00000100:00100000:2.0:1789427848.768072:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+9:9678:x1876350857136128:12345-192.168.201.55@tcp:36:touch.500 00010000:00010000:2.0:1789427848.768155:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427848.768233:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3434a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86e7 expref: 9 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.768257:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933410b41700) 00010000:00010000:2.0:1789427848.769071:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427848.769152:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.769219:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.769234:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427848.770835:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004efb1383 reply state 00000000bc80a684 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427848.770858:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427848.771465:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+10:9678:x1876350857136128:12345-192.168.201.55@tcp:36:touch.500 Request processed in 3393us (12112us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789427848.774435:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 23 00010000:00010000:3.0:1789427848.774473:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.774495:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.774504:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.774536:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401490a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427848.774543:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.774551:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.774567:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93342215be00) 00010000:00010000:3.0:1789427848.774571:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427848.774576:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.774583:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427848.776036:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.776139:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857136256 00000100:00100000:2.0:1789427848.776152:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857136256 00000100:00100000:2.0:1789427848.776335:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:2.0:1789427848.776348:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:9678:x1876350857136256:12345-192.168.201.55@tcp:101:touch.500 00010000:00010000:2.0:1789427848.776383:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427848.776411:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca3434b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a86ee expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.776488:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca3434b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86ee expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.776505:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca3434b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86ee expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.776527:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93342215bd00) 00010000:00010000:2.0:1789427848.776531:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427848.776536:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401490c00, rc 0) 00000100:00100000:2.0:1789427848.776717:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+10:9678:x1876350857136256:12345-192.168.201.55@tcp:101:touch.500 Request processed in 371us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.776724:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:1.0:1789427848.787070:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.787199:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857136384 00000100:00100000:2.0:1789427848.787217:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857136384 00000100:00100000:2.0:1789427848.787285:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:2.0:1789427848.787295:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876350857136384:12345-192.168.201.55@tcp:8:touch.500 00010000:00080000:2.0:1789427848.787336:0:8466:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:2.0:1789427848.787382:0:8466:0:(genops.c:1384:class_connect()) connect: client 691432fe-93d9-4afe-b1ac-013e2024784c, cookie 0x2bea1a57ca3434bf 00002000:00100000:2.0:1789427848.787397:0:8466:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 691432fe-93d9-4afe-b1ac-013e2024784c/ffff9334122d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789427848.787411:0:8466:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789427848.789328:0:8466:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789427848.789384:0:8466:0:(import.c:65:import_set_state_nolock()) ffff9334122d3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427848.789496:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2353:x1876350857136384:12345-192.168.201.55@tcp:8:touch.500 Request processed in 2198us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.789509:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:0.0:1789427848.798639:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427848.798848:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857136512 00000100:00100000:3.0:1789427848.798862:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857136512 00000100:00100000:3.0:1789427848.798965:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:3.0:1789427848.798977:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:0:x1876350857136512:12345-192.168.201.55@tcp:2:touch.500 00000100:00080000:2.0:1789427848.799637:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427848.854651:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:0:x1876350857136512:12345-192.168.201.55@tcp:2:touch.500 Request processed in 55660us (56009us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789427848.854669:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 17 00000001:00100000:0.0:1789427848.854803:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000001:00080000:0.0:1789427848.854822:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789427848.858525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.862514:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857136768 00000100:00100000:2.0:1789427848.862538:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857136768 00000100:00100000:2.0:1789427848.862667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:2.0:1789427848.862679:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+10:9678:x1876350857136768:12345-192.168.201.55@tcp:35:touch.500 00000100:00100000:2.0:1789427848.863320:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+11:9678:x1876350857136768:12345-192.168.201.55@tcp:35:touch.500 Request processed in 639us (4810us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789427848.863331:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:1.0:1789427848.902714:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427848.902818:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857136896 00000100:00100000:3.0:1789427848.902834:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857136896 00000100:00100000:3.0:1789427848.902911:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00100000:3.0:1789427848.902923:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+11:9679:x1876350857136896:12345-192.168.201.55@tcp:101:rm.0 00010000:00010000:3.0:1789427848.902957:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427848.903002:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3434c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a86f5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.903095:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca3434cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.903112:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca3434cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.903127:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca3434cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427848.903170:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789427848.903225:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789427848.903281:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca3434cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.903314:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3434c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86f5 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.903337:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca3434cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86f5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.903347:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:3.0:1789427848.903350:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427848.903355:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031000, rc 0) 00000100:00100000:3.0:1789427848.903427:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+12:9679:x1876350857136896:12345-192.168.201.55@tcp:101:rm.0 Request processed in 507us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427848.903435:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00100000:1.0:1789427848.912973:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427848.913143:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857137152 00000100:00100000:3.0:1789427848.913268:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857137152 00000100:00100000:3.0:1789427848.913347:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 26 00000100:00100000:3.0:1789427848.913359:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+12:9679:x1876350857137152:12345-192.168.201.55@tcp:101:rm.0 00010000:00010000:3.0:1789427848.913389:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427848.913417:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3434d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a86fc expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427848.913545:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789427848.913985:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3434d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86fc expref: 14 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.914002:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215ba00) 00010000:00010000:3.0:1789427848.914005:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427848.914011:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3434d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86fc expref: 14 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.914029:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030000, rc 0) 00000100:00100000:3.0:1789427848.914170:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+13:9679:x1876350857137152:12345-192.168.201.55@tcp:101:rm.0 Request processed in 813us (1215us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789427848.914293:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 26 00000100:00100000:0.0:1789427848.926668:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.927131:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857137280 00000100:00100000:2.0:1789427848.927147:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857137280 00000100:00100000:2.0:1789427848.927689:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:2.0:1789427848.927896:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+13:9679:x1876350857137280:12345-192.168.201.55@tcp:37:rm.0 00000100:00100000:2.0:1789427848.940730:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+13:9679:x1876350857137280:12345-192.168.201.55@tcp:37:rm.0 Request processed in 12823us (14060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.940748:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:1.0:1789427848.949166:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427848.949688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857137536 00000100:00100000:0.0:1789427848.949710:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857137536 00000100:00100000:0.0:1789427848.949815:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:0.0:1789427848.949824:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419ada850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+13:9679:x1876350857137536:12345-192.168.201.55@tcp:35:rm.0 00000100:00100000:0.0:1789427848.950500:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419ada850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+14:9679:x1876350857137536:12345-192.168.201.55@tcp:35:rm.0 Request processed in 673us (1343us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789427848.950509:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:0.0:1789427848.966735:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427848.967087:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857137792 00000100:00100000:3.0:1789427848.967101:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857137792 00000100:00100000:3.0:1789427848.967296:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 27 00000100:00100000:3.0:1789427848.967310:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+14:9679:x1876350857137792:12345-192.168.201.55@tcp:101:rm.0 00010000:00010000:3.0:1789427848.967344:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427848.967374:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3434e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8703 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.967533:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3434e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.967552:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3434e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.967823:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3434e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427848.967839:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789427848.968135:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca3434e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8703 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.968159:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3434e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8703 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.968168:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:3.0:1789427848.968172:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789427848.968818:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789427848.968921:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+16:9679:x1876350857137792:12345-192.168.201.55@tcp:101:rm.0 Request processed in 1612us (2198us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789427848.968932:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 27 00000100:00100000:1.0:1789427848.975900:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.976171:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857137920 00000100:00100000:2.0:1789427848.976288:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857137920 00000100:00100000:2.0:1789427848.976369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 28 00000100:00100000:2.0:1789427848.976380:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+16:9679:x1876350857137920:12345-192.168.201.55@tcp:41:rm.0 00000004:00000024:2.0:1789427848.976464:0:5834:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789427848.976550:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+16:9679:x1876350857137920:12345-192.168.201.55@tcp:41:rm.0 Request processed in 171us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.979779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 28 00000100:00100000:1.0:1789427848.982172:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427848.983299:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857138048 00000100:00100000:2.0:1789427848.983317:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857138048 00000100:00100000:2.0:1789427848.983407:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:2.0:1789427848.983419:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+16:9679:x1876350857138048:12345-192.168.201.55@tcp:101:rm.0 00010000:00010000:2.0:1789427848.983448:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427848.983476:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3434f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a870a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983577:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983597:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983612:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983631:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983639:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983646:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983843:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca34350c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983863:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca34350c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983870:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca34350c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427848.983905:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789427848.983910:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427848.983930:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca34350c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983943:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca34350c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983952:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983960:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983967:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983974:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401490a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427848.983980:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.983988:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.984002:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:2.0:1789427848.984005:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427848.985004:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985030:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3434fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985051:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985058:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985063:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985069:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401491c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427848.985073:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985080:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985093:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff93342215bf00) 00010000:00010000:2.0:1789427848.985096:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427848.985100:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985106:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343505 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985158:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3434f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a870a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985243:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca34350c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a870a expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427848.985252:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93342215bd00) 00010000:00010000:2.0:1789427848.985255:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427848.985257:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02aa00, rc 0) 00000100:00100000:2.0:1789427848.985352:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+17:9679:x1876350857138048:12345-192.168.201.55@tcp:101:rm.0 Request processed in 1934us (3193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427848.985361:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:0.0:1789427848.993086:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427848.993235:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857138304 00000100:00100000:3.0:1789427848.993249:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857138304 00000100:00100000:3.0:1789427848.993323:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00100000:3.0:1789427848.993336:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+17:9679:x1876350857138304:12345-192.168.201.55@tcp:36:rm.0 00010000:00010000:3.0:1789427848.993421:0:8694:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789427848.993477:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca34350c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a870a expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993506:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca3434b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86ee expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993521:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93342215bd00) 00010000:00010000:3.0:1789427848.993544:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca3434cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86f5 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993554:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:3.0:1789427848.993559:0:8694:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427848.993588:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993606:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993619:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993637:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993645:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993652:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993811:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993826:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.993834:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427848.994741:0:8694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789427848.994756:0:8694:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303929579908ns, next at 304929577014ns, rc = 0 00010000:00010000:3.0:1789427848.994839:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994851:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994861:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994869:0:8694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994876:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994882:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994909:0:8694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789427848.994931:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994937:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994952:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994957:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427848.994962:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994971:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994981:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933410b41e00) 00010000:00010000:3.0:1789427848.994985:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789427848.994990:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.994996:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343521 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.995015:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.995021:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.995027:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.995032:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427848.995035:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.995049:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.995057:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:3.0:1789427848.995059:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427848.995063:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427848.995068:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca343513 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427848.995078:0:8694:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ba90a6d0 reply state 00000000875fcfe7 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427848.995087:0:8694:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427848.995244:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+16:9679:x1876350857138304:12345-192.168.201.55@tcp:36:rm.0 Request processed in 1908us (2171us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789427848.995254:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 30 00010000:00010000:0.0:1789427848.996148:0:7625:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427848.996161:0:7625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427848.996218:0:7625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789427848.996223:0:7625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427848.996232:0:7625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427848.996247:0:7625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff933410b41e00) 00010000:00010000:0.0:1789427848.996249:0:7625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789427848.996254:0:7625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427848.996260:0:7625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343528 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427848.996283:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427848.996285:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427848.996287:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427849.005295:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427849.007119:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857138560 00000100:00100000:0.0:1789427849.007136:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857138560 00000100:00100000:1.0:1789427849.008160:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:1.0:1789427849.008210:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+16:9679:x1876350857138560:12345-192.168.201.55@tcp:35:rm.0 00000100:00100000:1.0:1789427849.008551:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+17:9679:x1876350857138560:12345-192.168.201.55@tcp:35:rm.0 Request processed in 377us (3269us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789427849.008560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 5 00010000:00010000:2.0:1789427849.009914:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427849.009934:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427849.009943:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427849.010262:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427849.010269:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427849.010280:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427849.010300:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff933410b41f00) 00010000:00010000:2.0:1789427849.010303:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427849.010309:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427849.010336:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34351a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427849.012290:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427849.012392:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857138816 00000100:00100000:3.0:1789427849.012405:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857138816 00000100:00100000:3.0:1789427849.012466:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 31 00000100:00100000:3.0:1789427849.012476:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+16:9679:x1876350857138816:12345-192.168.201.55@tcp:36:rm.0 00010000:00010000:3.0:1789427849.012548:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789427849.012579:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3434e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8703 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.012599:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401527400/0x2bea1a57ca343487 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86e0 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.012622:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933410b41800) 00010000:00010000:3.0:1789427849.012641:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343448 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86d2 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.012650:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215ba00) 00010000:00010000:3.0:1789427849.012657:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427849.012686:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.012713:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.012724:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.012737:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.012743:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.012749:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013044:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013053:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013071:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427849.013791:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789427849.013814:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013822:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013829:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013836:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427849.013842:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013851:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013862:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff933410b41200) 00010000:00010000:3.0:1789427849.013865:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789427849.013870:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013876:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031000/0x2bea1a57ca34353d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013897:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013903:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013915:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013920:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427849.013923:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013929:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013936:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933410b41e00) 00010000:00010000:3.0:1789427849.013939:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427849.013942:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.013947:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030000/0x2bea1a57ca34352f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427849.013959:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b7d85b73 reply state 00000000cb42a057 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427849.013970:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427849.014077:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+15:9679:x1876350857138816:12345-192.168.201.55@tcp:36:rm.0 Request processed in 1599us (1796us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789427849.014087:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 31 00010000:00010000:3.0:1789427849.018124:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.018147:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.018247:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.018255:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427849.018261:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.018271:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.018290:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff933410b41700) 00010000:00010000:3.0:1789427849.018293:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427849.018300:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427849.018307:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343536 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427849.417405:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427850.201163:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427850.201428:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427850.205532:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427850.205569:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427850.205724:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857138944 00000100:00100000:0.0:1789427850.205735:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857138944 00000100:00100000:0.0:1789427850.205794:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 249 00000100:00100000:0.0:1789427850.205804:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857138944:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427850.205875:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857138944:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 73us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427850.205882:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 249 00000100:00100000:3.0:1789427850.205937:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857139072 00000100:00100000:3.0:1789427850.205943:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857139072 00000100:00100000:2.0:1789427850.206063:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857139328 00000100:00100000:2.0:1789427850.206069:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857139328 00000100:00100000:3.0:1789427850.206130:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 101 00000100:00100000:3.0:1789427850.206137:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+14:2356:x1876350857139072:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427850.206211:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+14:2356:x1876350857139072:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 74us (5058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427850.206217:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 101 00000100:00100000:3.0:1789427850.206264:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857139200 00000100:00100000:3.0:1789427850.206268:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857139200 00000100:00100000:2.0:1789427850.219647:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 102 00000100:00100000:2.0:1789427850.219662:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857139328:12345-192.168.201.55@tcp:400:kworker.0 00000100:00080000:0.0:1789427850.220377:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427850.220386:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427850.220393:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857139328:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 732us (18962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427850.220400:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 102 00000100:00100000:3.0:1789427850.220519:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:3.0:1789427850.220529:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857139200:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427850.220578:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857139200:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 51us (15008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427850.220585:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 49 00010000:00010000:0.0:1789427850.441456:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427851.466201:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789427852.233740:0:6840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307168562088ns, next at 308168559473ns, rc = 0 00000100:00100000:3.0:1789427852.233766:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427852.233794:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877094144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427852.233940:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427852.233999:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877094144 00000100:00100000:3.0:1789427852.234005:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877094144 00000100:00100000:3.0:1789427852.234047:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789427852.234053:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877094144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427852.234081:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427852.234115:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877094144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427852.234120:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789427852.234154:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b901880 x1876350877094144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427852.234168:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877094144:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789427852.234309:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789427852.489733:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427853.257696:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877094272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427853.257841:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427853.258046:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877094272 00000100:00100000:2.0:1789427853.258056:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877094272 00000100:00100000:2.0:1789427853.258156:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789427853.258168:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877094272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427853.258240:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427853.258296:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877094272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427853.258304:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789427853.258352:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341de77800 x1876350877094272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427853.258370:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877094272:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789427853.258540:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427853.259418:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877094656:0@lo:400:kworker.0 00000100:00100000:1.0:1789427853.259473:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427853.259523:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427853.259530:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877094528:0@lo:400:kworker.0 00000100:00100000:1.0:1789427853.259554:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427853.259582:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877094656 00000100:00100000:1.0:1789427853.259588:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877094656 00000100:00100000:1.0:1789427853.259639:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877094528 00000100:00100000:1.0:1789427853.259643:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877094528 00000100:00100000:1.0:1789427853.259665:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789427853.259673:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877094656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427853.259719:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877094656:12345-0@lo:400:kworker.0 Request processed in 47us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427853.259726:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789427853.259740:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789427853.259746:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877094528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427853.259770:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877094528:12345-0@lo:400:kworker.0 Request processed in 25us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427853.259776:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1789427853.259873:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427853.259896:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877094528:0@lo:400:kworker.0 00000100:00100000:1.0:1789427853.259905:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877094656:0@lo:400:kworker.0 00000100:00100000:3.0:1789427853.259997:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877094400:0@lo:400:kworker.0 00000100:00100000:3.0:1789427853.260030:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427853.260063:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877094912:0@lo:400:kworker.0 00000100:00100000:3.0:1789427853.260083:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427853.260100:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789427853.260105:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877094784:0@lo:400:kworker.0 00000100:00100000:3.0:1789427853.260140:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427853.260170:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877094784 00000100:00100000:3.0:1789427853.260199:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877094784 00000100:00100000:3.0:1789427853.260228:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789427853.260235:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877094784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427853.260272:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877094784:12345-0@lo:400:kworker.0 Request processed in 37us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427853.260278:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789427853.260308:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933406141c00 x1876350877094784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427853.260319:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877094784:0@lo:400:kworker.0 00000100:00100000:3.0:1789427853.260334:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877094912 00000100:00100000:3.0:1789427853.260337:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877094912 00000100:00100000:3.0:1789427853.260363:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789427853.260369:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877094912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427853.260400:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877094912:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427853.260406:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1789427853.260420:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427853.260433:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877094912:0@lo:400:kworker.0 00000100:00100000:1.0:1789427853.262029:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877094400 00000100:00100000:1.0:1789427853.262041:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877094400 00000100:00100000:1.0:1789427853.262103:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789427853.262112:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877094400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427853.262224:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877094400:12345-0@lo:400:kworker.0 Request processed in 113us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427853.262230:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789427853.262400:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877094400:0@lo:400:kworker.0 00010000:00010000:1.0:1789427853.513782:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789427853.795741:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:1.0:1789427853.795760:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1789427853.795772:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789427853.795790:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1789427853.795795:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789427853.795953:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427853.795971:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877095040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789427853.796043:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427853.796111:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877095040 00000100:00100000:0.0:1789427853.796117:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877095040 00000100:00100000:0.0:1789427853.796154:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789427853.796160:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877095040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789427853.796210:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1789427853.796247:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa88089, atime: 0x6aa88089, ctime: 0x6aa88089, blocks: 0x1 00010000:00010000:0.0:1789427853.796254:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796270:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:0.0:1789427853.796275:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427853.796281:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796299:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796307:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796326:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796337:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789427853.796762:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877095040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 601us (719us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789427853.796767:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789427853.796787:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427853.796792:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796801:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789427853.796805:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796815:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796830:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796836:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca343544 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427853.796853:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427853.796860:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427853.796862:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789427853.796893:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff933441bcf100/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789427853.796899:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877095040:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789427854.314091:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1789427854.537416:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427855.325340:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427855.325382:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427855.325413:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427855.325447:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427855.325511:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857139456 00000100:00100000:0.0:1789427855.325521:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857139456 00000100:00100000:0.0:1789427855.325594:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 251 00000100:00100000:0.0:1789427855.325606:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857139456:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427855.325687:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857139456:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 83us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427855.325694:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 251 00000100:00100000:2.0:1789427855.325884:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857139584 00000100:00100000:2.0:1789427855.325890:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857139584 00000100:00100000:2.0:1789427855.325967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857139840 00000100:00100000:2.0:1789427855.325971:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857139840 00000100:00100000:2.0:1789427855.325995:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 106 00000100:00100000:2.0:1789427855.326002:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857139584:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427855.326044:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857139584:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 43us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427855.326051:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 106 00000100:00100000:2.0:1789427855.326064:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 107 00000100:00100000:2.0:1789427855.326085:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857139840:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427855.326109:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857139840:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 39us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427855.326114:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 107 00000100:00080000:1.0:1789427855.326302:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427855.326345:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857139712 00000100:00100000:3.0:1789427855.326351:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857139712 00000100:00100000:3.0:1789427855.326449:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:3.0:1789427855.326456:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857139712:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427855.326501:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857139712:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 45us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427855.326509:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00080000:0.0:1789427855.329834:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789427855.562088:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427856.585291:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427857.353577:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877095168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427857.353748:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427857.365380:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877095168 00000100:00100000:2.0:1789427857.365398:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877095168 00000100:00100000:2.0:1789427857.365471:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789427857.365483:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877095168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427857.365525:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789427857.365676:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427857.365757:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877095168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 275us (12008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427857.365765:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789427857.369672:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789427857.369684:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff933441bcf100, transno 4294967300 00000100:00100000:3.0:1789427857.369709:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877095168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789427857.609574:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427858.379459:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877095424:0@lo:400:kworker.0 00000100:00100000:1.0:1789427858.379578:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427858.380053:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877095936:0@lo:400:kworker.0 00000100:00100000:1.0:1789427858.380089:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427858.380140:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789427858.380146:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877095296:0@lo:400:kworker.0 00000100:00100000:1.0:1789427858.380214:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427858.380235:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877095808:0@lo:400:kworker.0 00000100:00100000:1.0:1789427858.380274:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427858.380311:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877095936 00000100:00100000:1.0:1789427858.380323:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877095936 00000100:00100000:1.0:1789427858.380389:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789427858.381754:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877095552:0@lo:400:kworker.0 00000100:00100000:3.0:1789427858.381897:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427858.381941:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877096064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427858.381969:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427858.382001:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427858.382008:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877095680:0@lo:400:kworker.0 00000100:00100000:3.0:1789427858.382108:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427858.382151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877095424 00000100:00100000:3.0:1789427858.382161:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877095424 00000100:00100000:3.0:1789427858.382259:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877095808 00000100:00100000:3.0:1789427858.382263:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877095808 00000100:00100000:3.0:1789427858.382283:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877095552 00000100:00100000:3.0:1789427858.382286:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877095552 00000100:00100000:3.0:1789427858.382304:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789427858.382313:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877095424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427858.382381:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877095424:12345-0@lo:400:kworker.0 Request processed in 68us (2803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427858.382388:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789427858.382506:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877095936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427858.382566:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877095936:12345-0@lo:400:kworker.0 Request processed in 2169us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427858.382574:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789427858.382774:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877095680 00000100:00100000:0.0:1789427858.382779:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877095680 00000100:00100000:0.0:1789427858.382813:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789427858.382821:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877095680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427858.382867:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877095680:12345-0@lo:400:kworker.0 Request processed in 46us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427858.382873:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789427858.382898:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789427858.382906:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877095808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427858.382940:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877095808:12345-0@lo:400:kworker.0 Request processed in 35us (2664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427858.382966:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789427858.382980:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789427858.382986:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877095552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427858.383016:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877095552:12345-0@lo:400:kworker.0 Request processed in 30us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427858.383033:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1789427858.383084:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427858.383091:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427858.383139:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877095808:0@lo:400:kworker.0 00000100:00100000:0.0:1789427858.383155:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877095424:0@lo:400:kworker.0 00010000:00080000:0.0:1789427858.383171:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d925180 x1876350877095936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427858.383207:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877095936:0@lo:400:kworker.0 00000100:00100000:0.0:1789427858.383254:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877096064 00000100:00100000:0.0:1789427858.383258:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877096064 00000100:00100000:0.0:1789427858.383285:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789427858.383292:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877096064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427858.383332:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427858.383370:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877096064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427858.383377:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789427858.383870:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877095296 00000100:00100000:2.0:1789427858.383877:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877095296 00000100:00100000:2.0:1789427858.383915:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789427858.383922:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877095296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427858.383979:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877095296:12345-0@lo:400:kworker.0 Request processed in 58us (3764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427858.384005:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789427858.384079:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877095296:0@lo:400:kworker.0 00000100:00100000:2.0:1789427858.384126:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877095680:0@lo:400:kworker.0 00000100:00100000:2.0:1789427858.384139:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877095552:0@lo:400:kworker.0 00010000:00080000:2.0:1789427858.384149:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b902300 x1876350877096064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427858.384165:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877096064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789427858.634842:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427859.658879:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789427859.668131:0:11619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1789427860.456921:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427860.457018:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427860.457065:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427860.457102:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427860.457166:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857140096 00000100:00100000:1.0:1789427860.457170:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857140352 00000100:00100000:3.0:1789427860.457210:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857140096 00000100:00100000:1.0:1789427860.457210:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857140352 00000100:00100000:3.0:1789427860.457280:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 111 00000100:00100000:1.0:1789427860.457293:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 112 00000100:00100000:3.0:1789427860.457295:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2354:x1876350857140096:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427860.457306:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857140352:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427860.457396:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857140224 00000100:00100000:2.0:1789427860.457402:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857140224 00000100:00100000:2.0:1789427860.457435:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 54 00000100:00100000:2.0:1789427860.457443:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2354:x1876350857140224:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427860.457515:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857140352:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 212us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427860.457523:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 112 00000100:00100000:3.0:1789427860.457616:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2354:x1876350857140096:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 325us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427860.457624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 111 00000100:00080000:3.0:1789427860.457662:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427860.457667:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427860.458364:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857139968 00000100:00100000:0.0:1789427860.458370:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857139968 00000100:00100000:0.0:1789427860.458406:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 253 00000100:00100000:0.0:1789427860.458425:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857139968:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427860.458608:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2354:x1876350857140224:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 1165us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427860.458617:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 54 00000100:00100000:0.0:1789427860.459418:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857139968:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 990us (2503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427860.459427:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 253 00010000:00010000:1.0:1789427860.681394:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789427861.325156:0:11667:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1cce4a30 20000000:00000080:3.0:1789427861.325360:0:11667:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff933420e05800 uarg=0000000000000000 20000000:01000000:3.0:1789427861.325411:0:11667:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789427861.325420:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789427861.325427:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789427861.326566:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789427861.327937:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789427861.339957:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789427861.340289:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789427861.340355:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789427861.340374:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789427861.340393:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.340412:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86bd expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.340419:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a86c4 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.340427:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3433f4 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.340433:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343402 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.340448:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343410 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.340456:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.340506:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343410 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.340522:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343410 expref: 18 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427861.340537:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5ffb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096192:0@lo:104: 00000100:00100000:3.0:1789427861.340597:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427861.341238:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877096192 00000100:00100000:0.0:1789427861.341250:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877096192 00000100:00100000:0.0:1789427861.341318:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789427861.341328:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11667:x1876350877096192:12345-0@lo:104: 00010000:00010000:0.0:1789427861.341343:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427861.341410:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427861.341417:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11667:x1876350877096192:12345-0@lo:104: Request processed in 92us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.341425:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789427861.341430:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427861.341440:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.341449:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427861.341453:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.341483:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427861.341491:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427861.341496:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789427861.341534:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.341540:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427861.341559:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.341566:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02be00/0x2bea1a57ca343410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343417 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.341581:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427861.341583:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427861.341585:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427861.341589:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca343402 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.341601:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca343402 expref: 18 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427861.341612:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096448:0@lo:104: 00000100:00100000:2.0:1789427861.341639:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427861.341663:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877096320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427861.341772:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427861.341783:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427861.341826:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877096448 00000100:00100000:1.0:1789427861.341831:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877096448 00000100:00100000:1.0:1789427861.341859:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789427861.341865:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11667:x1876350877096448:12345-0@lo:104: 00010000:00010000:1.0:1789427861.341873:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.341929:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3433f4 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.341940:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3433f4 expref: 18 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427861.341949:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e209880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096576:0@lo:104: 00000100:00100000:0.0:1789427861.342052:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877096320 00010000:00010000:1.0:1789427861.342057:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427861.342057:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877096320 00000100:00100000:1.0:1789427861.342066:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11667:x1876350877096448:12345-0@lo:104: Request processed in 200us (293us total) trans 0 rc 0/0 00010000:00010000:0.0:1789427861.342079:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343410 expref: 19 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427861.342084:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789427861.342165:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427861.342171:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.342205:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02b000 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789427861.342215:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.342223:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427861.342231:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427861.342236:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789427861.342267:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.342273:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427861.342293:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427861.342300:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427861.342305:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02b000/0x2bea1a57ca343402 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca343409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.342319:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427861.342321:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427861.342323:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427861.342335:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877096704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427861.342340:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86c4 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.342353:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86c4 expref: 12 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427861.342364:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096832:192.168.201.55@tcp:104: 00000100:00100000:2.0:1789427861.342372:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427861.342441:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877096704 00000100:00100000:1.0:1789427861.342445:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877096704 00010000:00010000:1.0:1789427861.342460:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343402 expref: 20 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427861.342498:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789427861.342507:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+20:3298:x1876350877096320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427861.342518:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427861.342524:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343410 expref: 20 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.342529:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86bd expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427861.342575:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789427861.342584:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+20:3300:x1876350877096704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427861.342592:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427861.342598:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca343402 expref: 20 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427861.342625:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86bd expref: 12 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427861.342644:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096960:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427861.342673:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff933406a7fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427861.342694:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5ffb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096192:0@lo:104: 00000100:00100000:3.0:1789427861.342703:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096448:0@lo:104: 00010000:00010000:1.0:1789427861.342812:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343410 expref: 20 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427861.342892:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca343402 expref: 20 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.342921:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7000/0x2bea1a57ca343417 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343410 expref: 20 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427861.342928:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e179800/0x2bea1a57ca343409 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca343402 expref: 20 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.342938:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427861.342942:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427861.346274:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3298:x1876350877096320:12345-0@lo:103:ldlm_bl.0 Request processed in 3757us (4480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427861.346292:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789427861.346512:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789427861.346533:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877096576 00000100:00100000:1.0:1789427861.346542:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877096576 00000100:00100000:1.0:1789427861.346593:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789427861.346602:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11667:x1876350877096576:12345-0@lo:104: 00010000:00010000:1.0:1789427861.346619:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.346751:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427861.346758:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+3:11667:x1876350877096576:12345-0@lo:104: Request processed in 157us (4462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427861.346766:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789427861.346822:0:7625:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427861.346828:0:7625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.346836:0:7625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c6c00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427861.346840:0:7625:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.346848:0:7625:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427861.346855:0:7625:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427861.346861:0:7625:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789427861.346898:0:7625:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.346904:0:7625:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427861.346926:0:7625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.346933:0:7625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff9334421c6c00/0x2bea1a57ca3433f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3433fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.346962:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427861.346963:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427861.346966:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427861.347588:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877096320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789427861.347625:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877097088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789427861.347861:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427861.348036:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877097088 00000100:00100000:1.0:1789427861.348169:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877097088 00010000:00010000:1.0:1789427861.348258:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3433f4 expref: 18 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427861.348317:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789427861.348325:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3301:x1876350877097088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427861.348335:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427861.348340:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3433f4 expref: 18 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.348351:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3433f4 expref: 18 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.348366:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427861.348400:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3301:x1876350877097088:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427861.348408:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789427861.348458:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877097088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427861.348547:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401527c00/0x2bea1a57ca3433fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3433f4 expref: 17 pid: 5827 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427861.348557:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e209880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096576:0@lo:104: 00000100:00100000:0.0:1789427861.349303:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3300:x1876350877096704:12345-0@lo:103:ldlm_bl.0 Request processed in 6718us (6933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427861.349311:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789427861.349438:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877096704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427861.352302:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427861.352347:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427861.352412:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857140480 00000100:00100000:2.0:1789427861.352422:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857140480 00010000:00010000:2.0:1789427861.352462:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86c4 expref: 13 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427861.352507:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857140608 00000100:00100000:2.0:1789427861.352511:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857140608 00010000:00010000:2.0:1789427861.352523:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86bd expref: 14 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427861.352545:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:2.0:1789427861.352555:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+14:2357:x1876350857140480:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427861.352569:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427861.352575:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86c4 expref: 14 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352587:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86c4 expref: 14 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352606:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427861.352667:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+14:2357:x1876350857140480:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 113us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427861.352675:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:2.0:1789427861.352693:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:2.0:1789427861.352700:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857140608:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427861.352708:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427861.352723:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86bd expref: 13 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352733:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86bd expref: 13 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352745:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352755:0:11166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352771:0:11166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352778:0:11166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352784:0:11166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352791:0:11166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352797:0:11166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789427861.352801:0:11166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352821:0:11166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352831:0:11166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427861.352848:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427861.352869:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857140608:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 169us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427861.352877:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 34 00010000:00010000:0.0:1789427861.353890:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401527600/0x2bea1a57ca3433ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86c4 expref: 12 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427861.353911:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096832:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427861.353927:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02ae00/0x2bea1a57ca3433e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a86bd expref: 11 pid: 5828 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427861.353936:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1876350877096960:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427861.353969:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427861.353978:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427861.353984:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427861.353990:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400030600/0x2bea1a57ca34354b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427861.705365:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427862.473918:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427862.473943:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877097216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427862.474095:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427862.474835:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877097216 00000100:00100000:0.0:1789427862.474861:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877097216 00000100:00100000:0.0:1789427862.474937:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789427862.474949:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877097216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427862.474987:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427862.475040:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877097216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427862.475047:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789427862.475072:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427862.477559:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877097216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789427862.729380:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789427862.985584:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789427862.985592:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93341d0db000 from 7 10000000:01000000:1.0:1789427862.985597:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789427862.985658:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427862.985690:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427862.985702:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427862.985726:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877097344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789427862.985798:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427862.985854:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410496240 going to sleep for 11 seconds 00000100:00100000:0.0:1789427862.985940:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877097344 00000100:00100000:0.0:1789427862.985950:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877097344 00000100:00100000:0.0:1789427862.986008:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789427862.986018:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:5831:x1876350877097344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427862.986031:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427862.986044:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e179000/0x2bea1a57ca343559 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427862.986066:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e179000/0x2bea1a57ca343559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343552 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427862.986077:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e179000/0x2bea1a57ca343559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343552 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427862.986087:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179000, rc 0) 00000100:00100000:0.0:1789427862.986134:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877097344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427862.986141:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789427862.986246:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877097344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427862.986259:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427862.986268:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427862.986319:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877097472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427862.986345:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427862.986373:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410496240 going to sleep for 11 seconds 00000100:00100000:0.0:1789427862.986422:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877097472 00000100:00100000:0.0:1789427862.986426:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877097472 00000100:00100000:0.0:1789427862.986485:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789427862.986500:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877097472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427862.986709:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877097472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427862.986716:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789427862.987061:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877097472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427862.987094:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877097600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427862.987136:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427862.987160:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93343a8c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427862.987247:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877097600 00000100:00100000:0.0:1789427862.987251:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877097600 00000100:00100000:0.0:1789427862.987275:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789427862.987280:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877097600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427862.987390:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877097600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427862.987397:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789427862.987473:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877097600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427862.991520:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11680:1876350877097728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427862.992077:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427862.992135:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410496e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427862.992231:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877097728 00000100:00100000:3.0:1789427862.992240:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877097728 00000100:00100000:3.0:1789427862.992306:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789427862.992319:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:11680:x1876350877097728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427862.992585:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:11680:x1876350877097728:12345-0@lo:502:llog_process_th.0 Request processed in 269us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427862.992594:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789427862.992762:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11680:1876350877097728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427862.992795:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427862.992806:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427862.992813:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789427862.992821:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93341d0db000 00000020:00000080:1.0:1789427862.992825:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789427862.992916:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11680:1876350877097856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427862.992957:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427862.992988:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410496e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427862.993073:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877097856 00000100:00100000:0.0:1789427862.993078:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877097856 00000100:00100000:0.0:1789427862.993115:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789427862.993123:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:11680:x1876350877097856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427862.993294:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:11680:x1876350877097856:12345-0@lo:502:llog_process_th.0 Request processed in 171us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427862.993301:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789427862.994679:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11680:1876350877097856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427862.994710:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427862.994715:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427862.994717:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789427862.994734:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789427862.998584:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789427862.998623:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789427862.998635:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427862.998648:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427862.998658:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789427862.998661:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933406156800 from 7 10000000:01000000:3.0:1789427862.998664:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789427862.998701:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427862.998709:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427862.998719:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427862.998745:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877097984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789427862.998809:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427862.998860:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933406a7f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789427862.999012:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877097984 00000100:00100000:1.0:1789427862.999021:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877097984 00000100:00100000:1.0:1789427862.999072:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789427862.999081:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:5831:x1876350877097984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427862.999095:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427862.999106:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933420700800/0x2bea1a57ca343567 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca343560 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427862.999127:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933420700800/0x2bea1a57ca343567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca343560 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427862.999137:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933420700800/0x2bea1a57ca343567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca343560 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427862.999145:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700800, rc 0) 00000100:00100000:1.0:1789427862.999224:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877097984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427862.999230:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789427863.000534:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877097984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427863.000558:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427863.000583:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427863.000650:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427863.000695:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427863.000736:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933406a7f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427863.000797:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877098112 00000100:00100000:2.0:1789427863.000803:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877098112 00000100:00100000:2.0:1789427863.000846:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789427863.000854:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877098112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427863.001121:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877098112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.001128:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789427863.001294:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427863.001323:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427863.001359:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427863.001483:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933406a7f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427863.007964:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877098240 00000100:00100000:2.0:1789427863.007980:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877098240 00000100:00100000:2.0:1789427863.008031:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789427863.008040:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877098240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427863.008417:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877098240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 377us (7056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.008426:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789427863.008958:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427863.009298:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11683:1876350877098368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427863.009345:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427863.009381:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff93343a8c5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427863.009500:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877098368 00000100:00100000:3.0:1789427863.009505:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877098368 00000100:00100000:3.0:1789427863.009534:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789427863.009543:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:11683:x1876350877098368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427863.009721:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:11683:x1876350877098368:12345-0@lo:502:llog_process_th.0 Request processed in 178us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.009729:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789427863.011504:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11683:1876350877098368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427863.011555:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427863.011567:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427863.011569:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789427863.011574:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff933406156800 00000020:00000080:1.0:1789427863.011576:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789427863.011659:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11683:1876350877098496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427863.011733:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427863.011770:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410496780 going to sleep for 11 seconds 00000100:00100000:3.0:1789427863.011835:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877098496 00000100:00100000:3.0:1789427863.011842:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877098496 00000100:00100000:3.0:1789427863.011890:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789427863.011899:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:11683:x1876350877098496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427863.012087:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:11683:x1876350877098496:12345-0@lo:502:llog_process_th.0 Request processed in 188us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.012095:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789427863.012331:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11683:1876350877098496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789427863.012350:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427863.012354:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427863.012356:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789427863.012360:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789427863.012667:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789427863.012686:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789427863.012696:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427863.012707:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427863.012717:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789427863.012720:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933433d9c800 from 7 10000000:01000000:3.0:1789427863.013051:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789427863.013082:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427863.013090:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427863.013100:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427863.013118:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789427863.013157:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427863.013501:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933406a7f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789427863.014978:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877098624 00000100:00100000:1.0:1789427863.014991:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877098624 00000100:00100000:1.0:1789427863.015101:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789427863.015111:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:5831:x1876350877098624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427863.015127:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427863.015142:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933420700000/0x2bea1a57ca343575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34356e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427863.015166:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933420700000/0x2bea1a57ca343575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34356e expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427863.015207:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933420700000/0x2bea1a57ca343575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34356e expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427863.015229:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700000, rc 0) 00000100:00100000:1.0:1789427863.015304:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877098624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427863.015311:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789427863.015325:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427863.015344:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427863.015354:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427863.015424:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427863.015477:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427863.015713:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b7b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789427863.015828:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877098752 00000100:00100000:3.0:1789427863.015833:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877098752 00000100:00100000:3.0:1789427863.015857:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789427863.015863:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877098752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427863.016081:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877098752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.016088:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789427863.016102:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427863.016138:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427863.016199:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427863.016216:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b7b900 going to sleep for 11 seconds 00000040:00080000:3.0:1789427863.016955:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789427863.017059:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877098880 00000100:00100000:3.0:1789427863.017064:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877098880 00000100:00100000:3.0:1789427863.017084:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789427863.017090:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877098880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789427863.017279:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:5831:x1876350877098880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.017286:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789427863.017290:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:5831:1876350877098880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427863.019157:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11685:1876350877099008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427863.019242:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427863.019284:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b7bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427863.019523:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877099008 00000100:00100000:2.0:1789427863.019544:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877099008 00000100:00100000:2.0:1789427863.019611:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789427863.019621:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:11685:x1876350877099008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427863.020107:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:11685:x1876350877099008:12345-0@lo:502:llog_process_th.0 Request processed in 480us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.020126:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789427863.020981:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11685:1876350877099008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427863.021017:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427863.021027:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427863.021029:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789427863.021039:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff933433d9c800 00000020:00000080:0.0:1789427863.021041:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789427863.021109:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11685:1876350877099136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427863.021166:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427863.021202:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410b7bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427863.022125:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877099136 00000100:00100000:3.0:1789427863.022134:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877099136 00000100:00100000:3.0:1789427863.024009:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789427863.024025:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:11685:x1876350877099136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427863.024301:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:11685:x1876350877099136:12345-0@lo:502:llog_process_th.0 Request processed in 279us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.024309:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789427863.024339:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:11685:1876350877099136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427863.024374:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427863.024383:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427863.024385:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789427863.024393:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789427863.024988:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789427863.025008:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789427863.025019:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427863.025032:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427863.320143:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427863.320314:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857140736 00000100:00100000:2.0:1789427863.320325:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857140736 00000100:00100000:2.0:1789427863.320408:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 269 00000100:00100000:2.0:1789427863.320425:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:5595:x1876350857140736:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789427863.320453:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427863.320473:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e02b000/0x2bea1a57ca34357c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8711 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427863.320500:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e02b000/0x2bea1a57ca34357c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8711 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427863.320508:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e02b000/0x2bea1a57ca34357c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8711 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427863.320530:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02b000, rc 0) 00000100:00100000:2.0:1789427863.320580:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857140736:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 Request processed in 165us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.320585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 269 00000100:00100000:2.0:1789427863.322726:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427863.323023:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857140864 00000100:00100000:3.0:1789427863.323089:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857140864 00000100:00100000:3.0:1789427863.323391:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 270 00000100:00100000:3.0:1789427863.323399:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857140864:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789427863.323677:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857140864:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 Request processed in 278us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.323688:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 270 00000100:00100000:3.0:1789427863.328242:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427863.328383:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857140992 00000100:00100000:2.0:1789427863.328392:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857140992 00000100:00100000:2.0:1789427863.328525:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 271 00000100:00100000:2.0:1789427863.328534:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857140992:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427863.328766:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857140992:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 Request processed in 232us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.328775:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 271 00000100:00100000:1.0:1789427863.332091:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427863.332162:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857141120 00000100:00100000:3.0:1789427863.332169:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857141120 00000100:00100000:3.0:1789427863.332224:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 272 00000100:00100000:3.0:1789427863.332231:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:9950:x1876350857141120:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789427863.332468:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:9950:x1876350857141120:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 234us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.332474:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 272 00000100:00100000:1.0:1789427863.335056:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427863.335204:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857141248 00000100:00100000:2.0:1789427863.335213:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857141248 00000100:00100000:2.0:1789427863.335260:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 273 00000100:00100000:2.0:1789427863.335268:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:9950:x1876350857141248:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789427863.335648:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:9950:x1876350857141248:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 380us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.335654:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 273 00000100:00100000:2.0:1789427863.339593:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427863.339989:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857141376 00000100:00100000:0.0:1789427863.340014:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857141376 00000100:00100000:0.0:1789427863.340069:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 274 00000100:00100000:0.0:1789427863.340081:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:5595:x1876350857141376:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427863.340099:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427863.340117:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e179a00/0x2bea1a57ca343583 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8718 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427863.340146:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e179a00/0x2bea1a57ca343583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8718 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427863.340157:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e179a00/0x2bea1a57ca343583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8718 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427863.340167:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179a00, rc 0) 00000100:00100000:0.0:1789427863.340260:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857141376:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 Request processed in 180us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427863.340267:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 274 00000100:00100000:1.0:1789427863.346624:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427863.346740:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857141504 00000100:00100000:2.0:1789427863.346748:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857141504 00000100:00100000:2.0:1789427863.346796:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 275 00000100:00100000:2.0:1789427863.346806:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857141504:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789427863.347093:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857141504:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 Request processed in 288us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.347098:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 275 00000100:00100000:1.0:1789427863.349712:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427863.350035:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857141632 00000100:00100000:0.0:1789427863.350044:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857141632 00000100:00100000:2.0:1789427863.350499:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 276 00000100:00100000:2.0:1789427863.350511:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857141632:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789427863.352463:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:5595:x1876350857141632:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 Request processed in 1945us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.352476:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 276 00000100:00100000:0.0:1789427863.371364:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427863.371510:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857141760 00000100:00100000:3.0:1789427863.371520:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857141760 00000100:00100000:3.0:1789427863.371573:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 277 00000100:00100000:3.0:1789427863.371583:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:9953:x1876350857141760:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789427863.371878:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:9953:x1876350857141760:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 295us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.371887:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 277 00000100:00100000:1.0:1789427863.375365:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427863.375620:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857141888 00000100:00100000:2.0:1789427863.375640:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857141888 00000100:00100000:3.0:1789427863.375721:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 278 00000100:00100000:3.0:1789427863.375734:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:9953:x1876350857141888:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789427863.376077:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:9953:x1876350857141888:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 346us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.376086:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 278 00000100:00100000:1.0:1789427863.497511:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789427863.497539:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877099264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427863.497617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427863.497697:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877099264 00000100:00100000:2.0:1789427863.497705:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877099264 00000100:00100000:1.0:1789427863.497707:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877099392:0@lo:400:kworker.0 00000100:00100000:2.0:1789427863.497778:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789427863.497788:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877099264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427863.497846:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427863.497898:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877099264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.497906:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789427863.497944:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427863.498045:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427863.498056:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877099520:0@lo:400:kworker.0 00000100:00100000:0.0:1789427863.498091:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789427863.498119:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427863.498130:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877099648:0@lo:400:kworker.0 00000100:00100000:0.0:1789427863.498154:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427863.498205:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877099520 00000100:00100000:0.0:1789427863.498210:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877099520 00000100:00100000:0.0:1789427863.498250:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877099648 00000100:00100000:0.0:1789427863.498253:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877099648 00000100:00100000:0.0:1789427863.498278:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789427863.498284:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877099520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427863.498321:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877099520:12345-0@lo:400:kworker.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427863.498327:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789427863.498344:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789427863.498350:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877099648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427863.498381:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877099648:12345-0@lo:400:kworker.0 Request processed in 31us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427863.498387:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789427863.498410:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427863.498447:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877099520:0@lo:400:kworker.0 00000100:00100000:0.0:1789427863.498473:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877099648:0@lo:400:kworker.0 00000100:00100000:0.0:1789427863.498498:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877099392 00000100:00100000:0.0:1789427863.498502:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877099392 00000100:00100000:0.0:1789427863.498532:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789427863.498539:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877099392:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789427863.499363:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341de77b80 x1876350877099264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427863.499381:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877099264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427863.500483:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427863.500497:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877099904:0@lo:400:kworker.0 00000100:00100000:3.0:1789427863.500508:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427863.500520:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877099776:0@lo:400:kworker.0 00000100:00100000:2.0:1789427863.500551:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427863.500562:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427863.500613:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877099776 00000100:00100000:2.0:1789427863.500619:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877099776 00000100:00100000:2.0:1789427863.500662:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789427863.500670:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877099776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427863.500715:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877099776:12345-0@lo:400:kworker.0 Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.500722:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789427863.500779:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877099392:12345-0@lo:400:kworker.0 Request processed in 2238us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427863.500786:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877099776:0@lo:400:kworker.0 00000100:00100000:0.0:1789427863.500787:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789427863.500850:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877099904 00000100:00100000:3.0:1789427863.500854:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877099904 00000100:00100000:3.0:1789427863.500889:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789427863.500893:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877099904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427863.500957:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877099904:12345-0@lo:400:kworker.0 Request processed in 63us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427863.500961:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789427863.500979:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877099904:0@lo:400:kworker.0 00000100:00080000:0.0:1789427863.501026:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427863.502205:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877099392:0@lo:400:kworker.0 00010000:00010000:2.0:1789427863.754048:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789427864.074334:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789427864.778144:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427865.560216:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427865.560268:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427865.560299:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427865.560361:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857142016 00000100:00100000:2.0:1789427865.560367:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857142272 00000100:00100000:2.0:1789427865.560377:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857142272 00000100:00100000:3.0:1789427865.560378:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857142016 00000100:00100000:0.0:1789427865.560387:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857142144 00000100:00100000:0.0:1789427865.560406:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857142144 00000100:00100000:3.0:1789427865.560453:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 280 00000100:00100000:0.0:1789427865.560463:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 116 00000100:00100000:3.0:1789427865.560465:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857142016:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427865.560479:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857142144:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427865.560523:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 56 00000100:00100000:2.0:1789427865.560533:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857142272:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427865.560538:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857142016:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427865.560549:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 280 00000100:00100000:0.0:1789427865.560550:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857142144:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 74us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427865.560561:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 116 00000100:00100000:2.0:1789427865.560574:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857142272:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 42us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427865.560582:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 56 00000100:00080000:0.0:1789427865.560593:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789427865.560599:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427865.560673:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427865.560735:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857142400 00000100:00100000:3.0:1789427865.560740:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857142400 00000100:00100000:3.0:1789427865.560779:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 117 00000100:00100000:3.0:1789427865.560788:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857142400:12345-192.168.201.55@tcp:400:kworker.0 00000100:00080000:1.0:1789427865.560794:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427865.560819:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857142400:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 32us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427865.560826:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 117 00010000:00010000:1.0:1789427865.801334:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427866.825780:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427867.593549:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877100032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427867.593652:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427867.597117:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877100032 00000100:00100000:2.0:1789427867.597138:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877100032 00000100:00100000:2.0:1789427867.597241:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789427867.597253:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877100032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427867.597301:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789427867.597308:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427867.597435:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877100032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (3782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427867.597446:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789427867.597516:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877100032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789427867.849471:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427868.617966:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877100416:0@lo:400:kworker.0 00000100:00100000:3.0:1789427868.618064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427868.618194:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877100288:0@lo:400:kworker.0 00000100:00100000:1.0:1789427868.618257:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427868.618285:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427868.618290:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877100160:0@lo:400:kworker.0 00000100:00100000:1.0:1789427868.618313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427868.618376:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877100416 00000100:00100000:1.0:1789427868.618385:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877100416 00000100:00100000:1.0:1789427868.618443:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877100288 00000100:00100000:1.0:1789427868.618447:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877100288 00000100:00100000:1.0:1789427868.618472:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789427868.618483:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877100416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427868.618620:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877100672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427868.618705:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427868.618766:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877100672 00000100:00100000:2.0:1789427868.618773:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877100672 00000100:00100000:2.0:1789427868.618820:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789427868.618830:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877100672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427868.618870:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427868.618914:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877100672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427868.618921:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789427868.618975:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341de76a00 x1876350877100672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427868.618996:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877100160 00000100:00100000:2.0:1789427868.619000:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877100672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427868.619007:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877100416:12345-0@lo:400:kworker.0 Request processed in 522us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427868.619020:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789427868.619026:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877100160 00000100:00100000:2.0:1789427868.619027:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427868.619040:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877100800:0@lo:400:kworker.0 00000100:00100000:1.0:1789427868.619051:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789427868.619062:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877100288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427868.619066:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789427868.619076:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877100160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427868.619086:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427868.619125:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877100288:12345-0@lo:400:kworker.0 Request processed in 64us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427868.619130:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877100160:12345-0@lo:400:kworker.0 Request processed in 57us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427868.619132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789427868.619137:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789427868.619156:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877100800 00000100:00100000:2.0:1789427868.619163:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877100800 00000100:00080000:1.0:1789427868.619170:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427868.619195:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877100544:0@lo:400:kworker.0 00000100:00080000:1.0:1789427868.619203:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427868.619236:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427868.619243:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877100160:0@lo:400:kworker.0 00000100:00100000:2.0:1789427868.619249:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789427868.619266:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877100800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427868.619270:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877100288:0@lo:400:kworker.0 00000100:00100000:3.0:1789427868.619392:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877100416:0@lo:400:kworker.0 00000100:00100000:2.0:1789427868.619826:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877100800:12345-0@lo:400:kworker.0 Request processed in 562us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427868.619826:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877100544 00000100:00100000:1.0:1789427868.619834:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877100544 00000100:00100000:2.0:1789427868.619841:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789427868.619895:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789427868.619899:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877100800:0@lo:400:kworker.0 00000100:00100000:1.0:1789427868.619912:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877100544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427868.619988:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877100544:12345-0@lo:400:kworker.0 Request processed in 82us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427868.619995:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789427868.620508:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877100544:0@lo:400:kworker.0 00010000:00010000:1.0:1789427868.873365:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427869.897366:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427870.680245:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427870.680290:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427870.680337:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857142528 00000100:00100000:3.0:1789427870.680348:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857142528 00000100:00100000:3.0:1789427870.680413:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 282 00000100:00100000:3.0:1789427870.680425:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857142528:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427870.680556:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857142528:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 133us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427870.680564:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 282 00000100:00100000:1.0:1789427870.682339:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857142656 00000100:00100000:1.0:1789427870.682354:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857142656 00000100:00100000:1.0:1789427870.682487:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 121 00000100:00100000:1.0:1789427870.682499:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857142656:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427870.682574:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857142656:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 78us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427870.682582:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 121 00000100:00080000:0.0:1789427870.682886:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427870.684651:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427870.684727:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857142912 00000100:00100000:1.0:1789427870.684740:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857142912 00000100:00080000:0.0:1789427870.684801:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427870.684853:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 122 00000100:00100000:1.0:1789427870.684866:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857142912:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427870.684940:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427870.684957:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857142912:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 93us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427870.684968:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 122 00000100:00100000:3.0:1789427870.685053:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857142784 00000100:00100000:3.0:1789427870.685059:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857142784 00000100:00100000:3.0:1789427870.685118:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:3.0:1789427870.685129:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2353:x1876350857142784:12345-192.168.201.55@tcp:9:kworker.0 00000100:00080000:1.0:1789427870.685135:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789427870.685154:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3434bf 00000100:00080000:3.0:1789427870.685231:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9334122d3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789427870.685653:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789427870.685969:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+2:2353:x1876350857142784:12345-192.168.201.55@tcp:9:kworker.0 Request processed in 842us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427870.685975:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 19 00010000:00010000:1.0:1789427870.686017:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427870.924643:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427871.947499:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427872.715424:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427872.715458:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877100928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427872.715541:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427872.715880:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877100928 00000100:00100000:2.0:1789427872.715889:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877100928 00000100:00100000:2.0:1789427872.715958:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789427872.715968:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877100928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427872.716000:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427872.716050:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877100928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427872.716058:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789427872.716103:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877100928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789427872.716420:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789427872.969629:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427873.737633:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877101312:0@lo:400:kworker.0 00000100:00100000:1.0:1789427873.737712:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877101184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427873.737822:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877101056:0@lo:400:kworker.0 00000100:00100000:2.0:1789427873.738871:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877101440:0@lo:400:kworker.0 00000100:00100000:0.0:1789427873.741627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427873.741768:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877101824:0@lo:400:kworker.0 00000100:00100000:0.0:1789427873.741806:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427873.741857:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877101312 00000100:00100000:0.0:1789427873.741865:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877101312 00000100:00100000:0.0:1789427873.741916:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789427873.741926:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877101312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427873.741950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427873.741981:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877101696:0@lo:400:kworker.0 00000100:00100000:3.0:1789427873.742005:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427873.742030:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877101696 00000100:00100000:3.0:1789427873.742044:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877101696 00000100:00100000:3.0:1789427873.742122:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789427873.742129:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877101696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427873.742163:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877101696:12345-0@lo:400:kworker.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427873.742169:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789427873.742203:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877101056 00000100:00100000:3.0:1789427873.742206:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877101056 00000100:00100000:3.0:1789427873.743096:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789427873.743110:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877101056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427873.743133:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877101312:12345-0@lo:400:kworker.0 Request processed in 1207us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427873.743142:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789427873.743158:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877101056:12345-0@lo:400:kworker.0 Request processed in 52us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427873.743165:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789427873.743208:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877101824 00000100:00100000:0.0:1789427873.743215:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877101824 00000100:00080000:3.0:1789427873.743637:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789427873.743642:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427873.743670:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877101056:0@lo:400:kworker.0 00000100:00100000:3.0:1789427873.743684:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877101696:0@lo:400:kworker.0 00000100:00100000:0.0:1789427873.743861:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789427873.743871:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877101824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427873.743915:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877101824:12345-0@lo:400:kworker.0 Request processed in 47us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427873.743922:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789427873.744196:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877101312:0@lo:400:kworker.0 00010000:00080000:3.0:1789427873.744220:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343b902300 x1876350877101824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427873.744240:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877101824:0@lo:400:kworker.0 00000100:00100000:2.0:1789427873.744706:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427873.744903:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877101440 00000100:00100000:3.0:1789427873.744910:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877101440 00000100:00100000:3.0:1789427873.744964:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789427873.744972:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877101440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427873.745033:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877101440:12345-0@lo:400:kworker.0 Request processed in 61us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427873.745040:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789427873.745068:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877101440:0@lo:400:kworker.0 00000100:00080000:0.0:1789427873.745563:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427873.748004:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427873.748353:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877101568:0@lo:400:kworker.0 00000100:00100000:2.0:1789427873.748409:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877101184 00000100:00100000:1.0:1789427873.748414:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427873.748419:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877101184 00000100:00100000:2.0:1789427873.748674:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789427873.748685:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877101184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427873.748726:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427873.748788:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877101184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427873.748795:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789427873.748975:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877101568 00000100:00100000:3.0:1789427873.748980:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877101568 00000100:00100000:3.0:1789427873.749012:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789427873.749019:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877101568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427873.749055:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877101568:12345-0@lo:400:kworker.0 Request processed in 37us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427873.749061:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789427873.749659:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341d927b80 x1876350877101184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427873.749681:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877101184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427873.749695:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877101568:0@lo:400:kworker.0 00010000:00010000:1.0:1789427873.993663:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789427874.314279:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1789427874.802578:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:3.0:1789427874.802586:0:6710:0:(genops.c:885:class_export_put()) final put ffff9334122d0800/691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:2.0:1789427874.802826:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9334122d0800/691432fe-93d9-4afe-b1ac-013e2024784c for lustre-OST0000 00000020:00000080:2.0:1789427874.802968:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9334122d3000 for lustre-OST0000 00010000:00010000:2.0:1789427875.017642:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427875.800844:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427875.800897:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427875.800946:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427875.801052:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857143168 00000100:00100000:1.0:1789427875.801068:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857143168 00000100:00080000:0.0:1789427875.801280:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427875.801409:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857143040 00000100:00100000:1.0:1789427875.801411:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857143296 00000100:00100000:3.0:1789427875.801426:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857143040 00000100:00100000:1.0:1789427875.801427:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857143296 00000100:00080000:0.0:1789427875.801502:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427875.801879:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 284 00000100:00100000:3.0:1789427875.801898:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857143040:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427875.801903:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 126 00000100:00100000:2.0:1789427875.801930:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857143168:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427875.802029:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857143040:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 136us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427875.802040:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 284 00000100:00100000:1.0:1789427875.802132:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 127 00000100:00100000:1.0:1789427875.802142:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857143296:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427875.802535:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857143168:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 613us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427875.802557:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 126 00000100:00100000:1.0:1789427875.802908:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857143296:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 766us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427875.802916:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 127 00010000:00010000:1.0:1789427876.041819:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427877.068165:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427877.838089:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427877.838117:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877101952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427877.838226:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427877.838284:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877101952 00000100:00100000:0.0:1789427877.838304:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877101952 00000100:00100000:0.0:1789427877.838359:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789427877.838368:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877101952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427877.838405:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427877.838458:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877101952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427877.838467:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789427877.838496:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427877.838554:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877101952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789427878.089632:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427878.857546:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877102208:0@lo:400:kworker.0 00000100:00100000:1.0:1789427878.857572:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877102464:0@lo:400:kworker.0 00000100:00100000:2.0:1789427878.857659:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877102336:0@lo:400:kworker.0 00000100:00100000:0.0:1789427878.857752:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877102080:0@lo:400:kworker.0 00000100:00100000:3.0:1789427878.857762:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427878.857824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427878.857857:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877102720:0@lo:400:kworker.0 00000100:00100000:0.0:1789427878.857865:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877102592:0@lo:400:kworker.0 00000100:00100000:3.0:1789427878.857894:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427878.857923:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427878.857973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877102208 00000100:00100000:3.0:1789427878.857985:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877102208 00000100:00100000:0.0:1789427878.858030:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877102720 00000100:00100000:0.0:1789427878.858037:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877102720 00000100:00100000:3.0:1789427878.858045:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877102592 00000100:00100000:3.0:1789427878.858050:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877102592 00000100:00100000:0.0:1789427878.858101:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789427878.858105:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789427878.858125:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877102208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427878.858125:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877102720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427878.858132:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427878.858252:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877102208:12345-0@lo:400:kworker.0 Request processed in 137us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427878.858255:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877102720:12345-0@lo:400:kworker.0 Request processed in 140us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427878.858261:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789427878.858269:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789427878.858288:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789427878.858298:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877102592:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789427878.858303:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789427878.858310:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427878.858353:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877102080 00000100:00100000:0.0:1789427878.858356:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877102080 00000100:00100000:0.0:1789427878.858385:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789427878.858397:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877102080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427878.858435:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877102080:12345-0@lo:400:kworker.0 Request processed in 44us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427878.858448:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789427878.858505:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877102080:0@lo:400:kworker.0 00000100:00100000:0.0:1789427878.858567:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877102208:0@lo:400:kworker.0 00010000:00080000:0.0:1789427878.858583:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410060380 x1876350877102720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789427894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427878.858594:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877102720:0@lo:400:kworker.0 00000100:00100000:3.0:1789427878.858792:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877102592:12345-0@lo:400:kworker.0 Request processed in 497us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427878.858798:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789427878.858975:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877102592:0@lo:400:kworker.0 00000100:00100000:2.0:1789427878.859644:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877102848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427878.859688:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427878.859860:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877102848 00000100:00100000:3.0:1789427878.859869:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877102848 00000100:00100000:3.0:1789427878.859923:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789427878.859930:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877102848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427878.859973:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427878.860042:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877102848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427878.860049:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789427878.860098:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933410063100 x1876350877102848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427878.860113:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877102848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427878.860898:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877102336 00000100:00100000:0.0:1789427878.860919:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877102336 00000100:00100000:0.0:1789427878.861025:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1789427878.861893:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427878.861944:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877102336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427878.862052:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877102336:12345-0@lo:400:kworker.0 Request processed in 1015us (3923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427878.862059:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789427878.862265:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877102336:0@lo:400:kworker.0 00000100:00100000:1.0:1789427878.862426:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427878.862517:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877102464 00000100:00100000:3.0:1789427878.862523:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877102464 00000100:00100000:3.0:1789427878.862557:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789427878.862565:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877102464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427878.862614:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877102464:12345-0@lo:400:kworker.0 Request processed in 50us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427878.862619:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789427878.862674:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877102464:0@lo:400:kworker.0 00010000:00010000:2.0:1789427879.113787:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427880.137760:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427880.920996:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427880.921032:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427880.921064:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427880.921245:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857143424 00000100:00100000:3.0:1789427880.921256:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857143424 00000100:00100000:3.0:1789427880.921310:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 286 00000100:00100000:3.0:1789427880.921320:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857143424:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427880.921393:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857143424:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 74us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427880.921400:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 286 00000100:00100000:2.0:1789427880.922000:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857143680 00000100:00100000:2.0:1789427880.922006:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857143680 00000100:00100000:2.0:1789427880.922050:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857143552 00000100:00100000:2.0:1789427880.922054:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857143552 00000100:00100000:2.0:1789427880.922078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 131 00000100:00100000:2.0:1789427880.922087:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857143680:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427880.922149:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857143680:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 62us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427880.922156:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 131 00000100:00100000:2.0:1789427880.922200:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 132 00000100:00100000:2.0:1789427880.922208:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857143552:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427880.922235:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857143552:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 29us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427880.922240:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 132 00000100:00080000:3.0:1789427880.922660:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789427881.161357:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427882.189302:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427882.953657:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427882.953680:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343a8c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877102976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427882.953739:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427882.953864:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877102976 00000100:00100000:2.0:1789427882.953873:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877102976 00000100:00100000:2.0:1789427882.953937:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789427882.953948:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877102976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427882.953994:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427882.954042:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877102976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427882.954049:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789427882.955147:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427882.955756:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343a8c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877102976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789427883.209773:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427883.977458:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427883.977632:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877103232:0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.977735:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427883.977831:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427883.977838:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877103360:0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.977866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427883.977923:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877103232 00000100:00100000:0.0:1789427883.977934:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877103232 00000100:00100000:0.0:1789427883.978008:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877103360 00000100:00100000:0.0:1789427883.978012:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877103360 00000100:00100000:0.0:1789427883.978073:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789427883.978083:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877103232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.978138:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877103232:12345-0@lo:400:kworker.0 Request processed in 57us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427883.978146:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789427883.978166:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789427883.978172:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877103360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.978216:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877103360:12345-0@lo:400:kworker.0 Request processed in 45us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427883.978222:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1789427883.978274:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427883.978313:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877103360:0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.978325:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877103232:0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.978537:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877103616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427883.978569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427883.978599:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427883.978604:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877103488:0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.978628:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427883.978653:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877103488 00000100:00100000:0.0:1789427883.978664:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877103488 00000100:00100000:0.0:1789427883.978692:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789427883.978698:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877103488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.978730:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877103488:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427883.978736:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789427883.978761:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877103488:0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.978785:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877103616 00000100:00100000:0.0:1789427883.978787:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877103616 00000100:00100000:0.0:1789427883.979047:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789427883.979055:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877103616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427883.979103:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427883.979143:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877103616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427883.979150:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789427883.979165:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789427883.979204:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341e20ad80 x1876350877103616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427883.979225:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877103616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427883.981387:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877103104:0@lo:400:kworker.0 00000100:00100000:1.0:1789427883.981504:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427883.981775:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877103104 00000100:00100000:0.0:1789427883.981787:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877103104 00000100:00100000:0.0:1789427883.981848:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789427883.981857:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877103104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.981910:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877103104:12345-0@lo:400:kworker.0 Request processed in 54us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427883.981918:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789427883.982022:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877103104:0@lo:400:kworker.0 00000100:00100000:2.0:1789427883.982196:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877103744:0@lo:400:kworker.0 00000100:00100000:2.0:1789427883.982380:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427883.982464:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877103744 00000100:00100000:0.0:1789427883.982479:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877103744 00000100:00100000:0.0:1789427883.982534:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789427883.982542:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877103744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427883.982579:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877103744:12345-0@lo:400:kworker.0 Request processed in 38us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427883.982586:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1789427883.982749:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427883.982817:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877103744:0@lo:400:kworker.0 00010000:00010000:1.0:1789427884.233279:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789427884.557481:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789427885.257396:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427886.043194:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427886.043229:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427886.043285:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427886.043342:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857144064 00000100:00100000:0.0:1789427886.043359:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857144064 00000100:00100000:0.0:1789427886.043415:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857143936 00000100:00100000:0.0:1789427886.043418:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857143936 00000100:00100000:0.0:1789427886.043441:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 136 00000100:00100000:0.0:1789427886.043450:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857144064:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427886.043536:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857144064:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427886.043543:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 136 00000100:00100000:0.0:1789427886.043560:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 137 00000100:00100000:0.0:1789427886.043568:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2354:x1876350857143936:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427886.043594:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2354:x1876350857143936:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427886.043600:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 137 00000100:00100000:1.0:1789427886.045849:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857143808 00000100:00100000:1.0:1789427886.045870:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857143808 00000100:00100000:1.0:1789427886.045928:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 288 00000100:00100000:1.0:1789427886.045938:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857143808:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427886.046004:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857143808:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 67us (2832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427886.046011:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 288 00000100:00080000:1.0:1789427886.046058:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789427886.282460:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789427886.990045:0:11850:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:18:05 (1789427885) 00010000:00010000:2.0:1789427887.308526:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427888.074025:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427888.074049:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343a8c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877103872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427888.074126:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427888.074434:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877103872 00000100:00100000:0.0:1789427888.074443:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877103872 00000100:00100000:0.0:1789427888.074511:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789427888.074521:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877103872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427888.074555:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427888.074603:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877103872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427888.074610:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789427888.074781:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427888.074818:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343a8c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877103872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789427888.329443:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427889.098437:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877104000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427889.098540:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427889.099803:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877104384:0@lo:400:kworker.0 00000100:00100000:3.0:1789427889.099845:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427889.099866:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427889.099870:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877104256:0@lo:400:kworker.0 00000100:00100000:3.0:1789427889.099884:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427889.099949:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877104128:0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.099997:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427889.100034:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877104640:0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100051:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427889.100068:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427889.100073:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877104512:0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100098:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427889.100130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877104384 00000100:00100000:0.0:1789427889.100140:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877104384 00000100:00100000:0.0:1789427889.100222:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877104256 00000100:00100000:0.0:1789427889.100225:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877104256 00000100:00100000:0.0:1789427889.100233:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877104640 00000100:00100000:0.0:1789427889.100235:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877104640 00000100:00100000:0.0:1789427889.100247:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789427889.100254:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877104384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100299:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877104384:12345-0@lo:400:kworker.0 Request processed in 46us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427889.100304:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789427889.100320:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789427889.100331:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877104256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100350:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877104256:12345-0@lo:400:kworker.0 Request processed in 19us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427889.100353:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789427889.100360:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789427889.100364:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877104640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100380:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876350877104640:12345-0@lo:400:kworker.0 Request processed in 17us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427889.100384:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789427889.100400:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877104512 00000100:00100000:0.0:1789427889.100403:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877104512 00000100:00100000:0.0:1789427889.100422:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789427889.100425:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877104512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100443:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877104512:12345-0@lo:400:kworker.0 Request processed in 18us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427889.100447:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789427889.100500:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877104256:0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100507:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877104384:0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100526:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877104512:0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100539:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877104640:0@lo:400:kworker.0 00000100:00100000:0.0:1789427889.100553:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877104000 00000100:00100000:0.0:1789427889.100555:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877104000 00000100:00100000:0.0:1789427889.100757:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789427889.100763:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877104000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427889.100801:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427889.100828:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877104000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427889.100833:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789427889.100898:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877104128 00000100:00100000:3.0:1789427889.100901:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877104128 00000100:00100000:3.0:1789427889.100932:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789427889.100936:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877104128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427889.100984:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877104128:12345-0@lo:400:kworker.0 Request processed in 46us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427889.100991:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789427889.101025:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877104128:0@lo:400:kworker.0 00000100:00080000:2.0:1789427889.102149:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427889.102169:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789427889.102254:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93341e208e00 x1876350877104000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789427905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427889.102279:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877104000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789427889.353380:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427889.946295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427889.953411:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857144192 00000100:00100000:2.0:1789427889.953432:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857144192 00000100:00100000:2.0:1789427889.953719:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 32 00000100:00100000:2.0:1789427889.953734:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:10223:x1876350857144192:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427889.953779:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427889.955629:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca34358a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a871f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.955717:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343591 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.955732:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.955746:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427889.955782:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789427889.955786:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427889.955890:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.955919:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca34358a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a871f expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.955942:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343591 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a871f expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.955951:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215b500) 00010000:00010000:2.0:1789427889.955962:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427889.955966:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02be00, rc 0) 00000100:00100000:2.0:1789427889.956718:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:10223:x1876350857144192:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 2984us (10585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427889.956746:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 32 00000100:00080000:0.0:1789427889.961513:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427889.973794:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427889.982046:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857144320 00000100:00100000:2.0:1789427889.982062:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857144320 00000100:00100000:2.0:1789427889.982137:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:2.0:1789427889.982148:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:10224:x1876350857144320:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427889.982169:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427889.982223:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8726 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983335:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983355:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983367:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983385:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983392:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983399:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983623:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca3435ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983644:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca3435ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983659:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca3435ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427889.983693:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789427889.983697:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427889.983727:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca3435ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983739:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983746:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983752:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983758:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02b200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427889.983762:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983769:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983780:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215b500) 00010000:00010000:2.0:1789427889.983783:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427889.983788:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.983806:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34359f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984071:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984080:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984086:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984092:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02bc00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427889.984095:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984102:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984110:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93342215b400) 00010000:00010000:2.0:1789427889.984113:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427889.984116:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984122:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3435a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984161:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8726 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984236:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca3435ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8726 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427889.984250:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93342215bf00) 00010000:00010000:2.0:1789427889.984253:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427889.984256:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02aa00, rc 0) 00000100:00100000:2.0:1789427889.984322:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:10224:x1876350857144320:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 2174us (10539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427889.984330:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:1.0:1789427889.989282:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427889.989435:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857144576 00000100:00100000:0.0:1789427889.989446:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857144576 00000100:00100000:0.0:1789427889.989505:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:0.0:1789427889.989516:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:10224:x1876350857144576:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427889.989539:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427889.989561:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca3435b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a872d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427889.989640:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427889.989657:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427889.989670:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.992398:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.992421:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.992433:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.992941:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca3435c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.992975:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca3435c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.992984:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca3435c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427889.992996:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789427889.993157:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.993165:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994707:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994780:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427889.994786:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994795:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994811:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93342215bf00) 00010000:00010000:1.0:1789427889.994814:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427889.994895:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994903:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca3435bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994924:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994949:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994964:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994969:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427889.994972:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994979:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.994988:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff933408914400) 00010000:00010000:1.0:1789427889.994990:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427889.994994:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.995000:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3435c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.997020:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca3435b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a872d expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.997046:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca3435c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a872d expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427889.997056:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:1.0:1789427889.997059:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427889.997069:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701200, rc 0) 00000100:00100000:1.0:1789427889.997145:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+9:10224:x1876350857144576:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 7629us (7874us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789427889.997155:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:0.0:1789427890.001636:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427890.001750:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857144704 00000100:00100000:2.0:1789427890.001760:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857144704 00000100:00100000:2.0:1789427890.001833:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 35 00000100:00100000:2.0:1789427890.001845:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+9:10224:x1876350857144704:12345-192.168.201.55@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789427890.001969:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+9:10224:x1876350857144704:12345-192.168.201.55@tcp:59:lhsmtool_posix.0 Request processed in 127us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427890.001977:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 35 00010000:00010000:1.0:1789427890.378307:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789427890.698566:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789427891.179332:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427891.179387:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427891.179427:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427891.179481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857145088 00000100:00100000:1.0:1789427891.179495:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857145088 00000100:00100000:1.0:1789427891.179566:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857144960 00000100:00100000:1.0:1789427891.179570:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857144960 00000100:00100000:1.0:1789427891.179601:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 141 00000100:00100000:1.0:1789427891.179613:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857145088:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427891.179707:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857145088:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 97us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427891.179715:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 141 00000100:00100000:1.0:1789427891.179736:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 142 00000100:00100000:1.0:1789427891.179744:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857144960:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427891.179776:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857144960:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 33us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427891.179782:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 142 00000100:00080000:1.0:1789427891.179807:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427891.181237:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857144832 00000100:00100000:2.0:1789427891.181249:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857144832 00000100:00100000:2.0:1789427891.181302:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 290 00000100:00100000:2.0:1789427891.181311:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857144832:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427891.181366:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857144832:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 57us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427891.181374:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 290 00010000:00010000:0.0:1789427891.402890:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427892.426202:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427892.544815:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427892.544888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857145216 00000100:00100000:1.0:1789427892.544898:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857145216 00000100:00100000:1.0:1789427892.546262:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:1.0:1789427892.546283:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:10267:x1876350857145216:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427892.546305:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427892.546326:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca3435d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8734 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546386:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546402:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546427:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546443:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546450:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546457:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546659:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546667:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546675:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546691:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427892.546695:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546703:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546715:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215b500) 00010000:00010000:1.0:1789427892.546718:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427892.546722:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546729:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3435de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546741:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546747:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546753:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546758:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427892.546762:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546768:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546784:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff933408914400) 00010000:00010000:1.0:1789427892.546787:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427892.546790:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546796:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3435e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546826:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca3435d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8734 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546835:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215b500) 00010000:00010000:1.0:1789427892.546837:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427892.546841:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca3435d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8734 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.546850:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701c00, rc 0) 00000100:00100000:1.0:1789427892.546929:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:10267:x1876350857145216:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 649us (2121us total) trans 0 rc 301/301 00000100:00100000:1.0:1789427892.546936:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:1.0:1789427892.564829:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427892.564900:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857145472 00000100:00100000:3.0:1789427892.564921:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857145472 00000100:00100000:3.0:1789427892.564984:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00100000:3.0:1789427892.564995:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+9:10267:x1876350857145472:12345-192.168.201.55@tcp:36:lfs.0 00010000:00010000:3.0:1789427892.565049:0:8694:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427892.565076:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343591 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a871f expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.565094:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93342215b500) 00010000:00010000:3.0:1789427892.565104:0:8694:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427892.565419:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.565434:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.565445:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.565457:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.565464:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.565479:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427892.568051:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789427892.568071:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.568081:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.568090:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.568096:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427892.568101:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.568108:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.568122:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933410b41400) 00010000:00010000:3.0:1789427892.568126:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427892.568131:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.568137:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3435ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427892.568156:0:8694:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cf74c8f4 reply state 000000005d677785 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427892.568232:0:8694:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427892.568353:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+10:10267:x1876350857145472:12345-192.168.201.55@tcp:36:lfs.0 Request processed in 3357us (3529us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789427892.568363:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 37 00010000:00010000:2.0:1789427892.573081:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.573099:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.573117:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.573124:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427892.573128:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.573136:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.573153:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff933410b41000) 00010000:00010000:2.0:1789427892.573156:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427892.573161:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.573167:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca3435f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427892.697609:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427892.697705:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857145600 00000100:00100000:0.0:1789427892.697716:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857145600 00000100:00100000:0.0:1789427892.697778:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 38 00000100:00100000:0.0:1789427892.697803:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+9:10275:x1876350857145600:12345-192.168.201.55@tcp:101:lctl.0 00010000:00010000:0.0:1789427892.697829:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427892.697866:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3435fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a873b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.697945:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca343601 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.697961:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca343601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.697973:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca343601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427892.698009:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789427892.698012:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427892.698050:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca343601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.698075:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3435fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a873b expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.698094:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca343601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a873b expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.698103:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083cab00) 00010000:00010000:0.0:1789427892.698106:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427892.698110:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178c00, rc 0) 00000100:00100000:0.0:1789427892.698219:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+10:10275:x1876350857145600:12345-192.168.201.55@tcp:101:lctl.0 Request processed in 374us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427892.698236:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 38 00000100:00100000:2.0:1789427892.809298:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427892.809566:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857145728 00000100:00100000:1.0:1789427892.809577:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857145728 00000100:00100000:1.0:1789427892.809643:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 39 00000100:00100000:1.0:1789427892.809653:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+10:10281:x1876350857145728:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:1.0:1789427892.809673:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427892.809711:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8742 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.809777:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.809792:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.809805:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.809819:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.809825:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.809831:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.809953:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34361d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.809962:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34361d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.809969:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34361d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427892.809999:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789427892.810003:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427892.810043:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34361d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810062:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810069:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810087:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810093:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427892.810098:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810105:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810117:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083cab00) 00010000:00010000:1.0:1789427892.810119:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427892.810124:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810130:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34360f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810142:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810147:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810152:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810163:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427892.810166:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810172:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810235:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff933408914400) 00010000:00010000:1.0:1789427892.810238:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427892.810241:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810246:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343616 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810650:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8742 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810667:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34361d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8742 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.810674:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427892.810676:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789427892.810679:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700400, rc 0) 00000100:00100000:1.0:1789427892.810792:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+11:10281:x1876350857145728:12345-192.168.201.55@tcp:101:bash.0 Request processed in 1140us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427892.810800:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 39 00000100:00100000:3.0:1789427892.821873:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427892.824991:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857145984 00000100:00100000:0.0:1789427892.825008:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857145984 00000100:00100000:0.0:1789427892.825092:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 40 00000100:00100000:0.0:1789427892.825103:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+11:10281:x1876350857145984:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:0.0:1789427892.825124:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427892.825145:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343624 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8749 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.825643:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.825660:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.825673:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.831734:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.831777:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.831790:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427892.833708:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789427892.834455:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834474:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834487:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834527:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834534:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834541:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834546:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427892.834551:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834558:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834587:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427892.834590:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427892.834595:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834601:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34362b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427892.834616:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000066a7d1fe reply state 00000000c007d160 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427892.834624:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789427892.834663:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343624 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8749 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834678:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8749 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.834686:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914400) 00010000:00010000:1.0:1789427892.834689:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427892.834691:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701c00, rc 0) 00000100:00100000:1.0:1789427892.834933:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+14:10281:x1876350857145984:12345-192.168.201.55@tcp:101:bash.0 Request processed in 9831us (13069us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789427892.834943:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 40 00010000:00010000:3.0:1789427892.847978:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.847999:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.848007:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.848014:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427892.848019:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.848026:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.848043:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914600) 00010000:00010000:3.0:1789427892.848046:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427892.848051:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.848057:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343632 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427892.853343:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427892.854231:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857146112 00000100:00100000:2.0:1789427892.854244:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857146112 00000100:00100000:2.0:1789427892.854307:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:2.0:1789427892.854316:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876350857146112:12345-192.168.201.55@tcp:8:bash.0 00010000:00080000:2.0:1789427892.854359:0:8466:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:2.0:1789427892.854392:0:8466:0:(genops.c:1384:class_connect()) connect: client 691432fe-93d9-4afe-b1ac-013e2024784c, cookie 0x2bea1a57ca343647 00002000:00100000:2.0:1789427892.854412:0:8466:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 691432fe-93d9-4afe-b1ac-013e2024784c/ffff933408305800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789427892.854437:0:8466:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789427892.854724:0:8466:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789427892.854755:0:8466:0:(import.c:65:import_set_state_nolock()) ffff933408302000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427892.855375:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2353:x1876350857146112:12345-192.168.201.55@tcp:8:bash.0 Request processed in 516us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427892.855387:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:2.0:1789427892.866394:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427892.869280:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857146240 00000100:00100000:0.0:1789427892.869296:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857146240 00000100:00100000:0.0:1789427892.869382:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00100000:0.0:1789427892.869394:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:0:x1876350857146240:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:0.0:1789427892.869414:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427892.869438:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8750 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789427892.869467:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789427892.869726:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1789427892.869732:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427892.869741:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8750 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.869762:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8750 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427892.869776:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179c00, rc 0) 00000100:00100000:0.0:1789427892.869948:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:0:x1876350857146240:12345-192.168.201.55@tcp:101:bash.0 Request processed in 555us (3565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427892.869956:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00080000:1.0:1789427892.870031:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427892.877034:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427892.877153:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857146368 00000100:00100000:2.0:1789427892.877164:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857146368 00000100:00100000:2.0:1789427892.877250:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:2.0:1789427892.877260:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:10281:x1876350857146368:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:2.0:1789427892.877289:0:8466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427892.877309:0:8466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8757 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.877339:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8750 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.877348:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427892.877353:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427892.877358:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 8 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.877391:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8750 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.877417:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8750 expref: 8 pid: 6685 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427892.877453:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8466:1876350877104768:192.168.201.55@tcp:104: 00000100:00100000:2.0:1789427892.877712:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420271540 going to sleep for 11 seconds 00000100:00100000:2.0:1789427892.882849:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8466:1876350877104768:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789427892.882890:0:8466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 8 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427892.882920:0:8466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02be00, rc 0) 00000100:00100000:2.0:1789427892.882988:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+8:10281:x1876350857146368:12345-192.168.201.55@tcp:101:bash.0 Request processed in 5728us (5964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427892.882997:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:2.0:1789427892.883650:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427892.883779:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857146496 00000100:00100000:3.0:1789427892.883801:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857146496 00010000:00010000:3.0:1789427892.883849:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8750 expref: 8 pid: 6685 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427892.883882:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 35 00000100:00100000:3.0:1789427892.883891:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+8:2355:x1876350857146496:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427892.883913:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427892.883935:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8750 expref: 8 pid: 6685 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.883950:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8750 expref: 8 pid: 6685 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.883976:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca34364e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8750 expref: 8 pid: 6685 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.883991:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427892.883995:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427892.884003:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.884012:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427892.884046:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427892.884073:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1876350877104896:192.168.201.55@tcp:105: 00000100:00100000:3.0:1789427892.884144:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427892.890021:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427892.890121:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857146752 00000100:00100000:1.0:1789427892.890131:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857146752 00000100:00100000:1.0:1789427892.890229:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:1.0:1789427892.890239:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+13:10281:x1876350857146752:12345-192.168.201.55@tcp:35:bash.0 00000100:00100000:1.0:1789427892.890645:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+14:10281:x1876350857146752:12345-192.168.201.55@tcp:35:bash.0 Request processed in 405us (632us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789427892.890653:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:3.0:1789427892.891472:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1876350877104896:192.168.201.55@tcp:105: 00010000:00010000:3.0:1789427892.891512:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427892.891595:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:2355:x1876350857146496:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 7704us (7946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427892.891604:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 35 00000100:00100000:2.0:1789427892.998064:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427892.998220:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857147008 00000100:00100000:1.0:1789427892.998232:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857147008 00000100:00100000:1.0:1789427892.998300:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 41 00000100:00100000:1.0:1789427892.998310:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+14:10291:x1876350857147008:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427892.998336:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427892.998357:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca34365c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a875e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427892.998459:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789427892.998584:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca34365c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a875e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.998602:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083cab00) 00010000:00010000:1.0:1789427892.998605:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427892.998611:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca34365c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a875e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427892.998627:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701a00, rc 0) 00000100:00100000:1.0:1789427892.998701:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+15:10291:x1876350857147008:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 392us (647us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789427892.998708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 41 00000100:00100000:0.0:1789427893.001298:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.001520:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857147264 00000100:00100000:1.0:1789427893.001541:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857147264 00000100:00100000:1.0:1789427893.001612:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:1.0:1789427893.001622:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+15:10291:x1876350857147264:12345-192.168.201.55@tcp:35:lfs.0 00000100:00080000:2.0:1789427893.001942:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427893.002032:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+16:10291:x1876350857147264:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 411us (741us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789427893.002041:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:2.0:1789427893.120887:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.121058:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857147392 00000100:00100000:1.0:1789427893.121070:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857147392 00000100:00100000:1.0:1789427893.121131:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:1.0:1789427893.121141:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+16:10297:x1876350857147392:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427893.121166:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427893.121226:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca34366a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8765 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.121483:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.121497:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.121511:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427893.121548:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789427893.121552:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427893.121569:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.121596:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca34366a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8765 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.121628:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8765 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.121637:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427893.121640:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427893.121644:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701400, rc 0) 00000100:00100000:1.0:1789427893.121750:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+17:10297:x1876350857147392:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 610us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427893.121759:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:3.0:1789427893.133670:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.133823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857147648 00000100:00100000:1.0:1789427893.133845:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857147648 00000100:00100000:1.0:1789427893.133926:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 43 00000100:00100000:1.0:1789427893.133936:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+17:10297:x1876350857147648:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427893.133958:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427893.133978:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343678 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a876c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.134090:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34367f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.134106:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34367f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.134118:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34367f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427893.134129:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789427893.134662:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343678 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a876c expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.134684:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34367f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a876c expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.134693:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914400) 00010000:00010000:1.0:1789427893.134696:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427893.134699:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700c00, rc 0) 00000100:00100000:1.0:1789427893.134768:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+19:10297:x1876350857147648:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 833us (1108us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789427893.134776:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 43 00000100:00100000:0.0:1789427893.143122:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.143297:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857147904 00000100:00100000:1.0:1789427893.143307:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857147904 00000100:00100000:1.0:1789427893.143358:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 44 00000100:00100000:1.0:1789427893.143366:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+19:10297:x1876350857147904:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427893.143389:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427893.143414:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca34368d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8773 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.143518:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343694 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.143534:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.143546:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427893.143581:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789427893.143710:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca34368d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8773 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.143730:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8773 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.143738:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914400) 00010000:00010000:1.0:1789427893.143741:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789427893.143745:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700e00, rc 0) 00000100:00100000:1.0:1789427893.143807:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:10297:x1876350857147904:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 440us (697us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789427893.143814:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 44 00000100:00100000:3.0:1789427893.144811:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427893.145096:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857148032 00000100:00100000:0.0:1789427893.145104:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857148032 00000100:00100000:0.0:1789427893.145156:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:0.0:1789427893.145165:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+21:2354:x1876350857148032:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427893.145211:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427893.145231:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34367f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a876c expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.145248:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914400) 00010000:00010000:0.0:1789427893.145252:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427893.145571:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+20:2354:x1876350857148032:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 405us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427893.145595:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:3.0:1789427893.156583:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427893.159971:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857148160 00000100:00100000:0.0:1789427893.159987:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857148160 00000100:00100000:0.0:1789427893.160066:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 23 00000100:00100000:0.0:1789427893.160076:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2355:x1876350857148160:12345-192.168.201.55@tcp:1:lfs.0 00010000:00010000:0.0:1789427893.160118:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.160139:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.160148:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789427893.160153:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427893.160158:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.160227:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.160243:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427893.160336:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876350877105024:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427893.160440:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8beb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427893.162738:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876350877105024:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427893.162788:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427893.163581:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427893.163807:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857148288 00000100:00100000:2.0:1789427893.163816:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857148288 00002000:00100000:2.0:1789427893.163879:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff93341e208700 x1876350857148288/t0(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:139/0 lens 504/0 e 0 to 0 dl 1789427904 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427893.163891:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93341e208700 with x1876350857148288 ext(0->12) 00010000:00010000:2.0:1789427893.163908:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 8 pid: 8466 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.163925:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 8 pid: 8466 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427893.163943:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93341e208700 00000100:00100000:2.0:1789427893.163981:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:2.0:1789427893.163990:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857148288:12345-192.168.201.55@tcp:4:lfs.0 00000100:00100000:0.0:1789427893.197387:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427893.197417:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877105152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427893.197487:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427893.197544:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877105152 00000100:00100000:0.0:1789427893.197552:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877105152 00000100:00100000:0.0:1789427893.197612:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789427893.197621:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877105152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427893.197662:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427893.197707:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877105152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427893.197714:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789427893.197739:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427893.197774:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877105152:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789427893.219963:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000100:00100000:3.0:1789427893.268114:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857148288:12345-192.168.201.55@tcp:4:lfs.0 Request processed in 104112us (104523us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789427893.268134:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 0 00002000:00100000:3.0:1789427893.268149:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff93341e208700 x1876350857148288/t4294967299(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:139/0 lens 504/448 e 0 to 0 dl 1789427904 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789427893.268159:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93341e208700 with x1876350857148288 ext(0->12) 00010000:00010000:3.0:1789427893.268170:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 9 pid: 8466 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.268221:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 9 pid: 8466 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427893.268231:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93341e208700 00000001:00080000:1.0:1789427893.268505:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789427893.277989:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427893.278563:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857148416 00000100:00100000:2.0:1789427893.278575:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857148416 00010000:00010000:2.0:1789427893.278615:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427893.278663:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:2.0:1789427893.278673:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2354:x1876350857148416:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427893.278687:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789427893.278710:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789427893.278713:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789427893 00002000:00010000:2.0:1789427893.278715:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789427893 00002000:00010000:2.0:1789427893.278718:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789427893 00002000:00010000:2.0:1789427893.278720:0:5820:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1789427893.278726:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.278741:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.278768:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343655 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8757 expref: 7 pid: 8466 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.278803:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427893.278807:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427893.278813:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.278822:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427893.278856:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427893.278927:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2354:x1876350857148416:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 254us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427893.278934:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 36 00010000:00010000:0.0:1789427893.279004:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.279014:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.279038:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.279047:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.279063:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.279072:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179200 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789427893.279076:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.279084:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.279096:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.279102:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035dee25f/0x2bea1a57ca3436a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427893.279148:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2355:x1876350857148160:12345-192.168.201.55@tcp:1:lfs.0 Request processed in 119074us (122577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427893.279156:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 23 00000100:00100000:2.0:1789427893.299278:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.299420:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857148672 00000100:00100000:1.0:1789427893.299431:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857148672 00000100:00100000:1.0:1789427893.299505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:1.0:1789427893.299517:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+20:10297:x1876350857148672:12345-192.168.201.55@tcp:35:lfs.0 00000004:00010000:1.0:1789427893.299581:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8773 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427893.299859:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1789427893.299930:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1789427893.300786:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1789427893.301140:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.301164:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8749 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.301397:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.301437:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8749 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.301453:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8749 expref: 24 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427893.301526:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1876350877105280:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427893.301694:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427893.306597:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1876350877105280:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427893.306627:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427893.310406:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427893.310625:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857148800 00000100:00100000:3.0:1789427893.310636:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857148800 00010000:00010000:3.0:1789427893.310678:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8749 expref: 25 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427893.310727:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00100000:3.0:1789427893.310737:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+25:2356:x1876350857148800:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427893.310753:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427893.310760:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8749 expref: 25 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.310774:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8749 expref: 25 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.310795:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8749 expref: 25 pid: 5836 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.310812:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914400) 00010000:00010000:3.0:1789427893.310817:0:11166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.310842:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.310849:0:11166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.310881:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427893.310958:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427893.310970:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+24:2356:x1876350857148800:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 235us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427893.310979:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 37 00010000:00010000:0.0:1789427893.310979:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427893.311100:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789427893.311344:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789427893.311463:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1876350877105408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789427893.311558:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427893.311588:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be000 going to sleep for 11 seconds 00000100:00100000:3.0:1789427893.312156:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877105408 00000100:00100000:3.0:1789427893.312163:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877105408 00000100:00100000:3.0:1789427893.312248:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789427893.312265:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1876350877105408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789427893.312340:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1876350877105408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427893.312347:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789427893.312620:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427893.312657:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1876350877105408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789427893.313299:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789427893.313365:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b0a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1876350877105536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789427893.313403:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427893.314090:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8bee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427893.323059:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877105536 00000100:00100000:3.0:1789427893.323075:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877105536 00000100:00100000:2.0:1789427893.329197:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427893.329213:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1876350877105536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789427893.329213:0:5840:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789427893.329223:0:5840:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789427893.329562:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5838:x1876350877105536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 352us (16157us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789427893.329571:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789427893.329841:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b0a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1876350877105536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789427893.329949:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789427893.329995:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.330005:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.330013:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.330020:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427893.330031:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.330043:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.330060:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914400) 00010000:00010000:1.0:1789427893.330064:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789427893.330069:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.330075:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427893.330684:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789427893.330980:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789427893.330992:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348265816335ns, next at 349265814343ns, rc = 0 00000001:00080000:1.0:1789427893.330999:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789427893.331037:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914400) 00010000:00010000:1.0:1789427893.331041:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789427893.331049:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343694 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8773 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427893.331371:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+27:10297:x1876350857148672:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 31854us (32100us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789427893.331381:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00000020:00080000:1.0:1789427893.331386:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789427893.338763:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427893.339320:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857148928 00000100:00100000:3.0:1789427893.339331:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857148928 00000100:00100000:3.0:1789427893.339394:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 45 00000100:00100000:3.0:1789427893.339406:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+27:10297:x1876350857148928:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427893.339434:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427893.339458:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3436b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a877a expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.339536:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3436b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a877a expref: 28 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.339551:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3436b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a877a expref: 28 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427893.339573:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:3.0:1789427893.339576:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427893.339595:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030400, rc 0) 00000100:00100000:3.0:1789427893.340755:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+28:10297:x1876350857148928:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 1345us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427893.340764:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 45 00000100:00100000:3.0:1789427893.344641:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427893.344728:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857149184 00000100:00100000:0.0:1789427893.344739:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857149184 00000100:00100000:0.0:1789427893.344801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:0.0:1789427893.344812:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419ad9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+28:10297:x1876350857149184:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:0.0:1789427893.345060:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419ad9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+29:10297:x1876350857149184:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 249us (427us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789427893.345069:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 9 00010000:00010000:1.0:1789427893.451150:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427893.536550:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.536684:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857149440 00000100:00100000:1.0:1789427893.536694:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857149440 00000100:00100000:1.0:1789427893.536762:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 46 00000100:00100000:1.0:1789427893.536771:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+29:10307:x1876350857149440:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427893.536794:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427893.536811:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8781 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427893.536906:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789427893.537022:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8781 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.537035:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083cab00) 00010000:00010000:1.0:1789427893.537038:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427893.537043:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8781 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.537057:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700e00, rc 0) 00000100:00100000:1.0:1789427893.537115:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+30:10307:x1876350857149440:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 344us (572us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1789427893.537123:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 46 00000100:00100000:2.0:1789427893.541294:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.541446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857149568 00000100:00100000:1.0:1789427893.541462:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857149568 00000100:00100000:1.0:1789427893.541518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00100000:1.0:1789427893.541526:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+30:10307:x1876350857149568:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:1.0:1789427893.541594:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541608:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541629:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541641:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541645:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541649:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541720:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541724:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541728:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427893.541760:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541769:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541773:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541778:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541789:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427893.541792:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541797:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541805:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427893.541807:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427893.541810:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541815:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541826:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541832:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541837:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541841:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427893.541844:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541850:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541867:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914400) 00010000:00010000:1.0:1789427893.541870:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427893.541873:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541879:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541904:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541910:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541915:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541920:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427893.541923:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541928:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541935:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427893.541937:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427893.541940:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.541944:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427893.542024:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+30:10307:x1876350857149568:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 498us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427893.542031:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00100000:3.0:1789427893.545009:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427893.545112:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857149824 00000100:00100000:0.0:1789427893.545123:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857149824 00000100:00100000:0.0:1789427893.545221:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:0.0:1789427893.545232:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+30:10307:x1876350857149824:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:0.0:1789427893.545473:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+31:10307:x1876350857149824:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 242us (472us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789427893.545480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:2.0:1789427893.592780:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.593207:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857150080 00000100:00100000:1.0:1789427893.593218:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857150080 00000100:00100000:1.0:1789427893.593278:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:1.0:1789427893.593287:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+31:10310:x1876350857150080:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427893.593312:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427893.593332:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8788 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593411:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593424:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593435:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593447:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593454:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593460:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593592:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593601:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593609:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427893.593618:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789427893.593714:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593721:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593728:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593733:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427893.593737:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593745:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593755:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427893.593758:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427893.593763:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593777:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca3436e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593791:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593796:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593802:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.593807:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427893.593810:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.594151:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.594160:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914400) 00010000:00010000:1.0:1789427893.594163:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427893.594166:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.594172:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3436e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.594320:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3436da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8788 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.594333:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8788 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.594348:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427893.594350:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427893.594352:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701600, rc 0) 00000100:00100000:1.0:1789427893.594436:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+33:10310:x1876350857150080:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 1150us (1664us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789427893.594444:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:2.0:1789427893.598101:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.598396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857150208 00000100:00100000:1.0:1789427893.598407:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857150208 00000100:00100000:1.0:1789427893.598465:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:1.0:1789427893.598475:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+33:10310:x1876350857150208:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:1.0:1789427893.598543:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.598560:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.598573:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.598599:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.598606:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.598612:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.598618:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427893.598634:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.598642:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.598654:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427893.598657:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427893.598662:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.598668:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca3436fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427893.598776:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+33:10310:x1876350857150208:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 302us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427893.598784:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:3.0:1789427893.603373:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427893.603540:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857150464 00000100:00100000:0.0:1789427893.603550:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857150464 00000100:00100000:0.0:1789427893.603597:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:0.0:1789427893.603607:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+33:10310:x1876350857150464:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:0.0:1789427893.603809:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+34:10310:x1876350857150464:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 203us (443us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789427893.603816:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:2.0:1789427893.925134:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427893.925409:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857150720 00000100:00100000:1.0:1789427893.925422:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857150720 00000100:00100000:1.0:1789427893.925487:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00100000:1.0:1789427893.925498:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+34:10341:x1876350857150720:12345-192.168.201.55@tcp:101:cat.0 00010000:00010000:1.0:1789427893.925528:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427893.925553:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a878f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.925667:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34370b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.925684:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34370b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.925707:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34370b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427893.925719:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789427893.926046:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a878f expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.926076:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34370b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a878f expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427893.926084:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427893.926087:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427893.926092:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701e00, rc 0) 00000100:00100000:1.0:1789427893.926266:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+36:10341:x1876350857150720:12345-192.168.201.55@tcp:101:cat.0 Request processed in 768us (1142us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789427893.926275:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00100000:2.0:1789427893.932295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427893.932348:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427893.932445:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857151104 00000100:00100000:0.0:1789427893.932456:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857151104 00000100:00100000:0.0:1789427893.932523:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:0.0:1789427893.932533:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+36:2355:x1876350857151104:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427893.932550:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427893.932575:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34370b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a878f expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427893.932593:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:0.0:1789427893.932598:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427893.932662:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+35:2355:x1876350857151104:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427893.932669:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:1.0:1789427893.932855:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857150976 00000100:00100000:1.0:1789427893.932860:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857150976 00000100:00100000:1.0:1789427893.932906:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:1.0:1789427893.932913:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+35:10341:x1876350857150976:12345-192.168.201.55@tcp:35:cat.0 00000100:00100000:1.0:1789427893.933120:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+36:10341:x1876350857150976:12345-192.168.201.55@tcp:35:cat.0 Request processed in 206us (833us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789427893.933126:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:3.0:1789427894.013040:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427894.013154:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857151360 00000100:00100000:1.0:1789427894.013165:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857151360 00000100:00100000:1.0:1789427894.013249:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:1.0:1789427894.013259:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+36:10347:x1876350857151360:12345-192.168.201.55@tcp:101:dd.0 00010000:00010000:1.0:1789427894.013296:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427894.013299:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789427894.013325:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8765 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.013344:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427894.013349:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427894.013362:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343719 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8796 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.013469:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.013483:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8788 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.013493:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.013527:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8788 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.013541:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8788 expref: 36 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427894.013554:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877105664:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427894.013663:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427894.022333:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427894.022429:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857151488 00000100:00100000:0.0:1789427894.022439:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857151488 00010000:00010000:0.0:1789427894.022480:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8788 expref: 37 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427894.022538:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 38 00000100:00100000:0.0:1789427894.022548:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+37:2356:x1876350857151488:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427894.022563:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427894.022569:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8788 expref: 37 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.022583:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8788 expref: 37 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.022605:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:0.0:1789427894.022759:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.022771:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.022779:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.022798:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427894.022921:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+37:2356:x1876350857151488:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 374us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427894.022929:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 38 00010000:00010000:1.0:1789427894.023330:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca3436ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8788 expref: 36 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427894.023355:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877105664:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427894.023375:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.023396:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.023402:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427894.023421:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789427894.023585:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343719 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8796 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.023600:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8796 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.023608:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427894.023724:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789427894.023727:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700e00, rc 0) 00000100:00100000:1.0:1789427894.023760:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+36:10347:x1876350857151360:12345-192.168.201.55@tcp:101:dd.0 Request processed in 10502us (10733us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789427894.023768:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:2.0:1789427894.029415:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427894.029573:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857151744 00000100:00100000:1.0:1789427894.029583:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857151744 00000100:00100000:1.0:1789427894.029755:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 52 00000100:00100000:1.0:1789427894.029766:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+36:10347:x1876350857151744:12345-192.168.201.55@tcp:36:dd.0 00010000:00010000:1.0:1789427894.030287:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.030305:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.030315:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427894.030365:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1789427894.030455:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002eb609ee reply state 000000003d662f3c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427894.030464:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427894.030603:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+39:10347:x1876350857151744:12345-192.168.201.55@tcp:36:dd.0 Request processed in 837us (1197us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789427894.030677:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 52 00000020:00080000:1.0:1789427894.030683:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789427894.042761:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.042781:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.042791:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.042796:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427894.042802:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.043138:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.043161:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:2.0:1789427894.043164:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427894.043170:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.043195:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34372e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427894.218376:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877105920:0@lo:400:kworker.0 00000100:00100000:3.0:1789427894.218449:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427894.218508:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877106432:0@lo:400:kworker.0 00000100:00100000:3.0:1789427894.218532:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427894.218561:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427894.218582:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877106048:0@lo:400:kworker.0 00000100:00100000:3.0:1789427894.218602:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427894.218916:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877105920 00000100:00100000:1.0:1789427894.218924:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877105920 00000100:00100000:1.0:1789427894.218976:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877106048 00000100:00100000:1.0:1789427894.218980:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877106048 00000100:00100000:1.0:1789427894.219012:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789427894.219021:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877105920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427894.219076:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877105920:12345-0@lo:400:kworker.0 Request processed in 56us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427894.219082:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789427894.219098:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789427894.219103:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877106048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427894.219148:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877106048:12345-0@lo:400:kworker.0 Request processed in 45us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427894.219154:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789427894.219368:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877106432 00000100:00100000:0.0:1789427894.219373:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877106432 00000100:00100000:0.0:1789427894.219413:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789427894.219421:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1876350877106432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427894.219463:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1876350877106432:12345-0@lo:400:kworker.0 Request processed in 43us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427894.219470:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1789427894.219488:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427894.219500:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877105792:0@lo:400:kworker.0 00000100:00100000:0.0:1789427894.219531:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427894.219556:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877106304:0@lo:400:kworker.0 00000100:00100000:0.0:1789427894.219594:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427894.219609:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427894.219615:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877106176:0@lo:400:kworker.0 00000100:00100000:0.0:1789427894.219636:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427894.219659:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877105792 00000100:00100000:0.0:1789427894.219663:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877105792 00000100:00100000:0.0:1789427894.219685:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789427894.219691:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877105792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427894.219723:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877105792:12345-0@lo:400:kworker.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427894.219729:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789427894.219766:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877105792:0@lo:400:kworker.0 00000100:00100000:1.0:1789427894.220532:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877106176 00000100:00100000:1.0:1789427894.220538:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877106176 00000100:00100000:1.0:1789427894.220593:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789427894.220601:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877106176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427894.220647:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877106176:12345-0@lo:400:kworker.0 Request processed in 47us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427894.220654:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789427894.220682:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877106176:0@lo:400:kworker.0 00000100:00100000:1.0:1789427894.220699:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877106304 00000100:00100000:1.0:1789427894.220701:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877106304 00000100:00100000:1.0:1789427894.220733:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789427894.220738:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877106304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427894.220772:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877106304:12345-0@lo:400:kworker.0 Request processed in 33us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427894.220778:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789427894.220791:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427894.220807:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877106304:0@lo:400:kworker.0 00000100:00100000:3.0:1789427894.221207:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877106048:0@lo:400:kworker.0 00000100:00100000:3.0:1789427894.221221:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877105920:0@lo:400:kworker.0 00000100:00100000:3.0:1789427894.221232:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877106432:0@lo:400:kworker.0 00000100:00100000:0.0:1789427894.221980:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427894.221992:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877106560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427894.222034:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427894.222271:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877106560 00000100:00100000:1.0:1789427894.222277:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877106560 00000100:00100000:1.0:1789427894.222319:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789427894.222327:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876350877106560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427894.222513:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427894.222746:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877106560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427894.222785:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876350877106560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 240us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427894.222805:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789427894.426632:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427894.426793:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857151872 00000100:00100000:1.0:1789427894.426804:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857151872 00000100:00100000:1.0:1789427894.426865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 53 00000100:00100000:1.0:1789427894.426884:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+38:10361:x1876350857151872:12345-192.168.201.55@tcp:101:stat.0 00010000:00010000:1.0:1789427894.426909:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427894.426930:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343735 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a879d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.426990:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427004:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427017:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427032:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427039:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427045:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427140:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427151:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8796 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427171:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427237:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8796 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.427251:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8796 expref: 39 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427894.427265:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877106688:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427894.427960:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427894.429210:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877106688:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427894.429236:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427894.429507:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427894.429638:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857152128 00000100:00100000:1.0:1789427894.429645:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857152128 00000100:00100000:1.0:1789427894.429698:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:1.0:1789427894.429706:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+40:5593:x1876350857152128:12345-192.168.201.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789427894.430048:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+41:5593:x1876350857152128:12345-192.168.201.55@tcp:35:ldlm_bl.0 Request processed in 341us (541us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789427894.430056:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:3.0:1789427894.431696:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427894.431817:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857152256 00000100:00100000:0.0:1789427894.431830:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857152256 00010000:00010000:0.0:1789427894.431901:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8796 expref: 41 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427894.431949:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 39 00000100:00100000:0.0:1789427894.431958:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+41:2356:x1876350857152256:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427894.431971:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427894.431978:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8796 expref: 41 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.431989:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8796 expref: 41 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.432009:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343720 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8796 expref: 41 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.432025:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:0.0:1789427894.432030:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.432039:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.432046:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.432078:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427894.432130:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+40:2356:x1876350857152256:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 172us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427894.432137:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 39 00010000:00010000:1.0:1789427894.432271:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432279:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427894.432322:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789427894.432326:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427894.432378:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432391:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432400:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432407:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432413:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432418:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427894.432423:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432430:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432438:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427894.432441:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427894.432444:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432450:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34373c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432471:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432477:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432482:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432486:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427894.432488:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432494:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432502:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914400) 00010000:00010000:1.0:1789427894.432504:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427894.432507:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432512:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432545:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343735 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a879d expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432557:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a879d expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.432573:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427894.432575:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427894.432577:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701000, rc 0) 00000100:00100000:1.0:1789427894.432625:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+39:10361:x1876350857151872:12345-192.168.201.55@tcp:101:stat.0 Request processed in 5752us (6002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427894.432632:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 53 00010000:00010000:1.0:1789427894.474316:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427894.512647:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427894.512795:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857152512 00000100:00100000:1.0:1789427894.512824:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857152512 00000100:00100000:1.0:1789427894.512930:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 54 00000100:00100000:1.0:1789427894.512943:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+39:10367:x1876350857152512:12345-192.168.201.55@tcp:36:truncate.0 00010000:00010000:1.0:1789427894.513021:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427894.513067:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca34374a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a879d expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.513093:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427894.513100:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427894.513494:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.513512:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.513524:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427894.513581:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789427894.513627:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ed3d59fc reply state 00000000baedf5e7 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427894.513637:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427894.513930:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+41:10367:x1876350857152512:12345-192.168.201.55@tcp:36:truncate.0 Request processed in 988us (1289us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789427894.513940:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 54 00000020:00080000:1.0:1789427894.513946:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789427894.516794:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.516832:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.516843:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.516849:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427894.516855:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.516864:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.516894:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427894.516898:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427894.516905:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427894.516911:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343751 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427894.664389:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427894.664500:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857152640 00000100:00100000:2.0:1789427894.664518:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857152640 00000100:00100000:2.0:1789427894.664693:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 55 00000100:00100000:2.0:1789427894.664707:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+40:10381:x1876350857152640:12345-192.168.201.55@tcp:101:stat.0 00010000:00010000:2.0:1789427894.664743:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427894.664770:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343758 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87a4 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.664901:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.664920:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.664935:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.664954:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.664961:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.664968:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665088:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665096:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665103:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427894.665162:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789427894.665167:0:8694:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427894.665273:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665289:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665300:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665307:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665314:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665320:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02b200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427894.665326:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665335:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665350:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:2.0:1789427894.665353:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427894.665358:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665365:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca34375f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665394:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665401:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665408:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665413:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02ae00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427894.665416:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665423:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665431:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93342215b000) 00010000:00010000:2.0:1789427894.665434:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427894.665437:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665442:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665479:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343758 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87a4 expref: 42 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665496:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87a4 expref: 41 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.665516:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:2.0:1789427894.665519:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427894.665522:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02be00, rc 0) 00000100:00100000:2.0:1789427894.665607:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+41:10381:x1876350857152640:12345-192.168.201.55@tcp:101:stat.0 Request processed in 903us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427894.665615:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 55 00000100:00100000:3.0:1789427894.723106:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427894.723658:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857152896 00000100:00100000:2.0:1789427894.723672:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857152896 00000100:00100000:2.0:1789427894.723787:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 56 00000100:00100000:2.0:1789427894.723796:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+41:10391:x1876350857152896:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427894.723837:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427894.723864:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87ab expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427894.723999:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789427894.724332:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343774 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ab expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.724345:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083cab00) 00010000:00010000:2.0:1789427894.724348:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427894.724352:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ab expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.724373:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02bc00, rc 0) 00000100:00100000:2.0:1789427894.724441:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+42:10391:x1876350857152896:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 646us (1351us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789427894.724464:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 56 00000100:00100000:3.0:1789427894.726882:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427894.727006:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857153152 00000100:00100000:0.0:1789427894.727017:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857153152 00000100:00100000:0.0:1789427894.727073:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00100000:0.0:1789427894.727085:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+42:10391:x1876350857153152:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:0.0:1789427894.727422:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+43:10391:x1876350857153152:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 340us (565us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789427894.727428:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 14 00000040:00080000:3.0:1789427894.797007:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789427894.801962:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427894.802032:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857153408 00000100:00100000:3.0:1789427894.802045:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857153408 00000100:00100000:3.0:1789427894.802111:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 57 00000100:00100000:3.0:1789427894.802123:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+43:10397:x1876350857153408:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:3.0:1789427894.802158:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427894.802216:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343782 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87b2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.802356:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.802375:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87a4 expref: 44 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.802385:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.802429:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87a4 expref: 44 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.802448:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87a4 expref: 44 pid: 8694 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427894.802464:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877106816:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427894.805549:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427894.820012:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427894.820053:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857153536 00000100:00100000:2.0:1789427894.820068:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857153536 00010000:00010000:2.0:1789427894.820121:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87a4 expref: 45 pid: 8694 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427894.820401:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 40 00000100:00100000:2.0:1789427894.820414:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+45:2356:x1876350857153536:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427894.820435:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427894.820444:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87a4 expref: 45 pid: 8694 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.820459:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87a4 expref: 45 pid: 8694 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.820489:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:2.0:1789427894.820495:0:11166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.820506:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.820514:0:11166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.820800:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34376d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87a4 expref: 45 pid: 8694 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427894.820820:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877106816:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789427894.822709:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427894.822831:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+44:2356:x1876350857153536:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 2412us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427894.822865:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 40 00010000:00010000:3.0:1789427894.822971:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.822985:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.822991:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427894.823018:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789427894.823412:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343782 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b2 expref: 45 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.823435:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b2 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.823444:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:3.0:1789427894.823446:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789427894.823449:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031c00, rc 0) 00000100:00100000:3.0:1789427894.823506:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+44:10397:x1876350857153408:12345-192.168.201.55@tcp:101:bash.0 Request processed in 21386us (21559us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789427894.823514:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 57 00000100:00100000:0.0:1789427894.833698:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427894.833793:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857153792 00000100:00100000:2.0:1789427894.833806:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857153792 00000100:00100000:2.0:1789427894.833887:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 58 00000100:00100000:2.0:1789427894.833898:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+44:10397:x1876350857153792:12345-192.168.201.55@tcp:36:bash.0 00010000:00010000:2.0:1789427894.834604:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.834628:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.834641:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789427894.834739:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789427894.834767:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c1d6dca3 reply state 000000004451d40a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427894.834779:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427894.835001:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+47:10397:x1876350857153792:12345-192.168.201.55@tcp:36:bash.0 Request processed in 1102us (1313us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789427894.835010:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 58 00000020:00080000:2.0:1789427894.835017:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1789427894.843570:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000020:00080000:2.0:1789427894.843612:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93341e8be000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789427894.843624:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341c194600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93341e8be900 00000020:00080000:2.0:1789427894.843628:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341c194b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93343fc7a000 00000004:00080000:2.0:1789427894.843691:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789427894.845009:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.845030:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.845049:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.845055:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02bc00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427894.845061:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.845070:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.845091:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:2.0:1789427894.845094:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427894.845100:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.845106:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343797 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427894.847158:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427894.847287:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857153920 00000100:00100000:2.0:1789427894.847301:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857153920 00000100:00100000:2.0:1789427894.847379:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 59 00000100:00100000:2.0:1789427894.847391:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+14:10397:x1876350857153920:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:2.0:1789427894.847425:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427894.847451:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca34379e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87b9 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.847591:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.847608:0:8694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b2 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.847617:0:8694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.847662:0:8694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b2 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.847677:0:8694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b2 expref: 15 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427894.847694:0:8694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877106944:192.168.201.55@tcp:104: 00000020:00080000:1.0:1789427894.847750:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1789427894.847798:0:8694:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64240 going to sleep for 11 seconds 00000020:00080000:1.0:1789427894.847921:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789427894.848430:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789427894.848445:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b0a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877107072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789427894.848498:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427894.848588:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877107072 00000100:00100000:2.0:1789427894.848596:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877107072 00000100:00100000:2.0:1789427894.848649:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789427894.848658:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877107072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789427894.848684:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789427894.848720:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa880b5, atime: 0x6aa880b5, ctime: 0x6aa880b5, blocks: 0xb 00010000:00010000:2.0:1789427894.848728:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.848744:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1789427894.848757:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427894.848764:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.848782:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.848793:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.848801:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.848828:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789427894.849569:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3299:x1876350877107072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 908us (1067us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789427894.849581:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1789427894.849647:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93343b0a2680/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789427894.849655:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b0a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877107072:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789427894.850060:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427894.850071:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.850085:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789427894.850091:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.850116:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.850140:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.850160:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca3437ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427894.850215:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427894.850218:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427894.850220:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427894.855014:0:8694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877106944:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427894.855069:0:8694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427894.857065:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427894.858266:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857154048 00000100:00100000:0.0:1789427894.858284:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857154048 00010000:00010000:0.0:1789427894.858347:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b2 expref: 16 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427894.858401:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 41 00000100:00100000:0.0:1789427894.858412:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+16:2357:x1876350857154048:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427894.858432:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427894.858440:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b2 expref: 16 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.858482:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b2 expref: 16 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.858532:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca343789 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b2 expref: 16 pid: 5835 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.858556:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:0.0:1789427894.858562:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.858573:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.858581:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427894.858623:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427894.858719:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+15:2357:x1876350857154048:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 304us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427894.858726:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 41 00010000:00010000:2.0:1789427894.859229:0:8694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.859241:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427894.859304:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789427894.859310:0:8694:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427894.859338:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.859405:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca34379e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b9 expref: 15 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.859425:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b9 expref: 14 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427894.859435:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:2.0:1789427894.859438:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427894.859441:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02b200, rc 0) 00000100:00100000:2.0:1789427894.859632:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+14:10397:x1876350857153920:12345-192.168.201.55@tcp:101:bash.0 Request processed in 12101us (12357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427894.859641:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 59 00000100:00100000:3.0:1789427894.863858:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427894.865164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857154304 00000100:00100000:0.0:1789427894.865200:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857154304 00000100:00100000:0.0:1789427894.865277:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:0.0:1789427894.865290:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419ad9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+14:10397:x1876350857154304:12345-192.168.201.55@tcp:35:bash.0 00000100:00100000:0.0:1789427894.865702:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419ad9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+15:10397:x1876350857154304:12345-192.168.201.55@tcp:35:bash.0 Request processed in 414us (1859us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789427894.865710:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:1.0:1789427895.031629:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427895.031730:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857154560 00000100:00100000:3.0:1789427895.031746:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857154560 00000100:00100000:3.0:1789427895.031860:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 60 00000100:00100000:3.0:1789427895.031892:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+15:10407:x1876350857154560:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427895.031932:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427895.031960:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3437b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427895.032102:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789427895.032353:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3437b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87c0 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.032399:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083cab00) 00010000:00010000:3.0:1789427895.032402:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427895.032409:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3437b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87c0 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.032426:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789427895.032512:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+16:10407:x1876350857154560:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 623us (899us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789427895.032521:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 60 00000100:00080000:1.0:1789427895.033073:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427895.039701:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427895.039829:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857154688 00000100:00100000:1.0:1789427895.039843:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857154688 00000100:00100000:1.0:1789427895.039934:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 61 00000100:00100000:1.0:1789427895.039946:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+16:10407:x1876350857154688:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:1.0:1789427895.040047:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040068:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040085:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040102:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040110:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040117:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040592:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040608:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040617:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427895.040688:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040705:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040712:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040721:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040727:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427895.040732:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040741:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040756:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427895.040760:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427895.040766:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040772:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3437c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040785:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040791:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040806:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040811:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427895.040814:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040820:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040828:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914400) 00010000:00010000:1.0:1789427895.040831:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427895.040834:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040839:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3437c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040857:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040880:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040887:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040893:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427895.040896:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040911:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040920:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427895.040922:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427895.040926:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.040932:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.041036:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+16:10407:x1876350857154688:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 1089us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427895.041045:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 61 00000100:00100000:0.0:1789427895.051791:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.051982:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857154944 00000100:00100000:2.0:1789427895.051998:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857154944 00000100:00100000:2.0:1789427895.052075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:2.0:1789427895.052087:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+16:10407:x1876350857154944:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427895.052484:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+17:10407:x1876350857154944:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 399us (708us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789427895.052494:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:3.0:1789427895.110943:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.111430:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857155200 00000100:00100000:2.0:1789427895.111445:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857155200 00000100:00100000:2.0:1789427895.111529:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 62 00000100:00100000:2.0:1789427895.111541:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+17:10410:x1876350857155200:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427895.111574:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427895.111604:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca3437d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87c7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.111727:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.111745:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.111761:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.111781:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.111789:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.111796:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.112605:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3437eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.112620:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3437eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.112628:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3437eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427895.112641:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789427895.112763:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.112771:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.112786:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.112792:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02bc00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427895.112797:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.112805:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.112999:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:2.0:1789427895.113004:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427895.113012:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113019:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3437dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113099:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113107:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113113:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113118:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427895.113121:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113139:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113326:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93342215b700) 00010000:00010000:2.0:1789427895.113328:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427895.113332:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113338:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3437e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113413:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca3437d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87c7 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113430:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3437eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87c7 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.113437:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:2.0:1789427895.113439:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427895.113442:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a400, rc 0) 00000100:00100000:2.0:1789427895.113536:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+19:10410:x1876350857155200:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 1996us (2606us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789427895.113546:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 62 00000100:00100000:3.0:1789427895.118654:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427895.118713:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427895.118829:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857155328 00000100:00100000:1.0:1789427895.118844:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857155328 00000100:00100000:1.0:1789427895.118922:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 63 00000100:00100000:1.0:1789427895.118934:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+19:10410:x1876350857155328:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:1.0:1789427895.119032:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.119064:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.119080:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.119116:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.119153:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.119161:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.119168:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427895.119197:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.119206:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.119220:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:1.0:1789427895.119223:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427895.119229:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.119235:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3437f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.119330:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+19:10410:x1876350857155328:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 397us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427895.119338:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 63 00000100:00100000:3.0:1789427895.123399:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427895.123620:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857155712 00000100:00100000:1.0:1789427895.123634:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857155712 00000100:00100000:1.0:1789427895.123700:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:1.0:1789427895.123712:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+19:10410:x1876350857155712:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:1.0:1789427895.124073:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+20:10410:x1876350857155712:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 361us (686us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789427895.124099:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:2.0:1789427895.125221:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857155456 00000100:00100000:2.0:1789427895.125234:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857155456 00000100:00100000:2.0:1789427895.125333:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:2.0:1789427895.125343:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+20:2356:x1876350857155456:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427895.125386:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427895.125415:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3437eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87c7 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.125438:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:2.0:1789427895.125444:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427895.125505:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+19:2356:x1876350857155456:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 163us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.125512:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:3.0:1789427895.292755:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427895.292876:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857155968 00000100:00100000:1.0:1789427895.292891:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857155968 00000100:00100000:1.0:1789427895.292969:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 64 00000100:00100000:1.0:1789427895.292982:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+19:10428:x1876350857155968:12345-192.168.201.55@tcp:101:cat.0 00010000:00010000:1.0:1789427895.293022:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427895.293056:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343800 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87ce expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.293235:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343807 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.293255:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343807 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.293268:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343807 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427895.293282:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789427895.293795:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343800 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ce expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.293822:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ce expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.293833:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:0.0:1789427895.293836:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789427895.293841:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701c00, rc 0) 00000100:00100000:0.0:1789427895.293940:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+21:10428:x1876350857155968:12345-192.168.201.55@tcp:101:cat.0 Request processed in 960us (1202us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789427895.293949:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 64 00000100:00100000:0.0:1789427895.349797:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427895.349919:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857156096 00000100:00100000:1.0:1789427895.349934:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857156096 00000100:00100000:1.0:1789427895.350020:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 65 00000100:00100000:1.0:1789427895.350042:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+21:10429:x1876350857156096:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427895.350075:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427895.350101:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87d5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.350244:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34381c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.350279:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34381c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.350294:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34381c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427895.350343:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789427895.350348:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427895.350371:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34381c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.350404:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87d5 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.350426:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34381c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87d5 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427895.350437:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427895.350440:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427895.350445:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700c00, rc 0) 00000100:00100000:1.0:1789427895.350526:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:10429:x1876350857156096:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 487us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427895.350535:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 65 00000100:00100000:1.0:1789427895.366873:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.367137:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857156480 00000100:00100000:2.0:1789427895.367151:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857156480 00000100:00100000:2.0:1789427895.367294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 18 00000100:00100000:2.0:1789427895.367307:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+22:10429:x1876350857156480:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427895.368909:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+23:10429:x1876350857156480:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 1594us (2052us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789427895.368924:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 18 00000100:00100000:3.0:1789427895.375728:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.375994:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857156608 00000100:00100000:2.0:1789427895.376009:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857156608 00000100:00100000:2.0:1789427895.376480:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:2.0:1789427895.376496:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+23:10429:x1876350857156608:12345-192.168.201.55@tcp:103:lfs.0 00010000:00010000:2.0:1789427895.376526:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789427895.376562:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca3437a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87b9 expref: 23 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.376593:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ce expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.376633:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3436b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a877a expref: 21 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.376646:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933410b41d00) 00010000:00010000:2.0:1789427895.376661:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427895.376741:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+20:10429:x1876350857156608:12345-192.168.201.55@tcp:103:lfs.0 Request processed in 249us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.376750:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:0.0:1789427895.380924:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.381016:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857156736 00000100:00100000:2.0:1789427895.381030:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857156736 00000100:00100000:2.0:1789427895.381116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 66 00000100:00100000:2.0:1789427895.381129:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+20:10429:x1876350857156736:12345-192.168.201.55@tcp:58:lfs.0 00010000:00010000:2.0:1789427895.381318:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.381342:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.381367:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789427895.382157:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789427895.382444:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789427895.382535:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789427895.382685:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+20:10429:x1876350857156736:12345-192.168.201.55@tcp:58:lfs.0 Request processed in 1554us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.382697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 66 00000100:00100000:1.0:1789427895.423895:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427895.424230:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857156864 00000100:00100000:3.0:1789427895.424245:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857156864 00000100:00100000:3.0:1789427895.424336:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 67 00000100:00100000:3.0:1789427895.424350:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+20:10431:x1876350857156864:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427895.424394:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427895.424424:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34382a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.424521:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.424558:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.424573:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.424592:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.424973:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.424981:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.425905:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.425921:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.425932:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427895.425989:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789427895.425997:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789427895.426023:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426037:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426063:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426069:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426077:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426082:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427895.426088:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426096:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426111:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:3.0:1789427895.426115:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427895.426121:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426128:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426147:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426153:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426158:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.426169:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427895.426172:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.427659:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.427683:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933410b41600) 00010000:00010000:3.0:1789427895.427686:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427895.427692:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.427700:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343838 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.427779:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34382a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87dc expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.427796:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87dc expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.427804:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93342215b700) 00010000:00010000:3.0:1789427895.427806:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789427895.427809:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031800, rc 0) 00000100:00100000:3.0:1789427895.427935:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+21:10431:x1876350857156864:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 3587us (4055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427895.427946:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 67 00010000:00010000:2.0:1789427895.503985:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789427895.817415:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427895.817438:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427895.817494:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789427895.817501:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427895.817640:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877107200:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789427895.817743:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427895.829811:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877107200:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789427895.836980:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427895.837235:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857156992 00000100:00100000:1.0:1789427895.837249:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857156992 00000100:00100000:1.0:1789427895.837314:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:1.0:1789427895.837325:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:691432fe-93d9-4afe-b1ac-013e2024784c+21:10442:x1876350857156992:12345-192.168.201.55@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789427895.837458:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:691432fe-93d9-4afe-b1ac-013e2024784c+21:10442:x1876350857156992:12345-192.168.201.55@tcp:900:lhsmtool_posix.0 Request processed in 134us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427895.837467:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:0.0:1789427895.844949:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.845049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857157120 00000100:00100000:2.0:1789427895.845064:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857157120 00000100:00100000:2.0:1789427895.845270:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 68 00000100:00100000:2.0:1789427895.845285:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:10442:x1876350857157120:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789427895.845335:0:5834:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789427895.845815:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:10442:x1876350857157120:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 531us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.845826:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 68 00000100:00100000:3.0:1789427895.858051:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427895.871414:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857157248 00000100:00100000:0.0:1789427895.871438:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857157248 00000100:00100000:0.0:1789427895.871569:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 69 00000100:00100000:0.0:1789427895.871582:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+21:10442:x1876350857157248:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789427895.871685:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.871710:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.871726:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.871975:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872001:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872015:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872051:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872060:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872067:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427895.872291:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789427895.872296:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427895.872313:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872326:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872332:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872339:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872363:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427895.872368:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872375:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872388:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:0.0:1789427895.872391:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427895.872396:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872402:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343846 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872418:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872425:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872430:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872436:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427895.872438:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872444:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872461:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9334083ca700) 00010000:00010000:0.0:1789427895.872464:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427895.872467:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872472:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca34384d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872489:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872495:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872500:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872505:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427895.872510:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872515:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872522:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93342215b700) 00010000:00010000:0.0:1789427895.872524:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427895.872527:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.872605:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343854 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427895.872712:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+21:10442:x1876350857157248:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 Request processed in 1128us (14671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427895.872721:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 69 00000100:00100000:0.0:1789427895.882043:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.884120:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857157504 00000100:00100000:2.0:1789427895.884144:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857157504 00000100:00100000:0.0:1789427895.884404:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 70 00000100:00100000:0.0:1789427895.884420:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+21:10442:x1876350857157504:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427895.884442:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427895.884461:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34385b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884567:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884583:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884595:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427895.884619:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789427895.884717:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884725:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884731:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884752:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427895.884757:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884764:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884774:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93342215b700) 00010000:00010000:0.0:1789427895.884777:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427895.884782:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884788:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343862 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884840:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34385b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87e3 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884861:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:0.0:1789427895.884864:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427895.884868:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34385b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87e3 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427895.884877:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178600, rc 0) 00000100:00100000:0.0:1789427895.884949:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+22:10442:x1876350857157504:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 532us (2915us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1789427895.884956:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 70 00000100:00100000:0.0:1789427895.894280:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427895.894367:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857157632 00000100:00100000:1.0:1789427895.894379:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857157632 00000100:00100000:1.0:1789427895.894436:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 71 00000100:00100000:1.0:1789427895.894446:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:10442:x1876350857157632:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789427895.894481:0:5835:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789427895.894599:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:10442:x1876350857157632:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427895.894607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 71 00000100:00100000:3.0:1789427895.897008:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.897091:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857157888 00000100:00100000:2.0:1789427895.897101:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857157888 00000100:00100000:2.0:1789427895.897153:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 72 00000100:00100000:2.0:1789427895.897163:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+22:10442:x1876350857157888:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427895.897219:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427895.897222:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789427895.897246:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca34381c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87d5 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.897262:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:2.0:1789427895.897267:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427895.897279:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343870 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87ea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789427895.897885:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789427895.898147:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.898165:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.898206:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.898264:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343870 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ea expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.898278:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ea expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.898284:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215ba00) 00010000:00010000:2.0:1789427895.898287:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427895.898289:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02ae00, rc 0) 00000100:00100000:2.0:1789427895.898361:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+23:10442:x1876350857157888:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 1199us (1361us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789427895.898368:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 72 00000100:00100000:0.0:1789427895.915773:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.915977:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857158144 00000100:00100000:2.0:1789427895.915988:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857158144 00000100:00100000:2.0:1789427895.916038:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 73 00000100:00100000:2.0:1789427895.916049:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+23:10442:x1876350857158144:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789427895.916102:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427895.916129:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ea expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.916156:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215ba00) 00010000:00010000:2.0:1789427895.916191:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427895.916213:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.916227:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.916237:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.917705:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.917725:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.917735:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.917964:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.917973:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.917980:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.917986:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427895.917991:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918000:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918019:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:2.0:1789427895.918022:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427895.918027:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918033:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343885 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918044:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918050:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918056:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918061:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02bc00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427895.918064:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918070:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918077:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x99e6ea44 (ffff93342215bd00) 00010000:00010000:2.0:1789427895.918078:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427895.918081:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.918086:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca34388c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x99e6ea44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427895.918207:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:10442:x1876350857158144:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 2156us (2440us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789427895.918216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 73 00000100:00100000:0.0:1789427895.933330:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.933461:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857158272 00000100:00100000:2.0:1789427895.933473:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857158272 00000100:00100000:2.0:1789427895.933530:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 74 00000100:00100000:2.0:1789427895.933540:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+22:10442:x1876350857158272:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427895.933561:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427895.933583:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343893 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87f1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.933620:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.933634:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.933646:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.933743:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f1 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.933762:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f1 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.933770:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:2.0:1789427895.933780:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789427895.933784:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401490c00, rc 0) 00000100:00100000:2.0:1789427895.933862:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+23:10442:x1876350857158272:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 323us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.933870:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 74 00000100:00100000:1.0:1789427895.946489:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.946815:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857158528 00000100:00100000:2.0:1789427895.946825:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857158528 00000100:00100000:2.0:1789427895.946895:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 75 00000100:00100000:2.0:1789427895.946906:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+23:10442:x1876350857158528:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789427895.946989:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.947008:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.947022:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789427895.947341:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1789427895.947354:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350882178130ns, next at 351882174995ns, rc = 0 00000004:00010000:2.0:1789427895.947446:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006d989f49 reply state 00000000c087209b transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427895.947457:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427895.947554:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+25:10442:x1876350857158528:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 649us (1074us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789427895.947563:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 75 00010000:00010000:3.0:1789427895.949487:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.949504:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.949513:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.949519:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401491600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427895.949525:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.949534:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.949553:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:3.0:1789427895.949556:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789427895.949563:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427895.949569:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427895.955742:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.956281:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857158656 00000100:00100000:2.0:1789427895.956291:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857158656 00000100:00100000:2.0:1789427895.956375:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 76 00000100:00100000:2.0:1789427895.956386:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+24:10442:x1876350857158656:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427895.956412:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427895.956435:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87f8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.956503:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f8 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.956519:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f8 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427895.956540:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:2.0:1789427895.956544:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427895.956548:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401491c00, rc 0) 00000100:00100000:2.0:1789427895.956604:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+25:10442:x1876350857158656:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 220us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.956611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 76 00000100:00100000:0.0:1789427895.965794:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.965877:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857158784 00000100:00100000:2.0:1789427895.965888:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857158784 00000100:00100000:2.0:1789427895.965937:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00100000:2.0:1789427895.965945:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876350857158784:12345-192.168.201.55@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789427895.965977:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:2.0:1789427895.966007:0:6685:0:(genops.c:1384:class_connect()) connect: client 691432fe-93d9-4afe-b1ac-013e2024784c, cookie 0x2bea1a57ca3438af 00002000:00100000:2.0:1789427895.966017:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 691432fe-93d9-4afe-b1ac-013e2024784c/ffff93341c3fa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789427895.966040:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789427895.966313:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789427895.966352:0:6685:0:(import.c:65:import_set_state_nolock()) ffff93341c3f8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789427895.966425:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2353:x1876350857158784:12345-192.168.201.55@tcp:8:lhsmtool_posix.0 Request processed in 478us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427895.966432:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00100000:1.0:1789427895.975981:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427895.976051:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857158912 00000100:00100000:2.0:1789427895.976061:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857158912 00000100:00100000:2.0:1789427895.976124:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 26 00000100:00100000:2.0:1789427895.976135:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:0:x1876350857158912:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789427895.976759:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789427896.077126:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1789427896.077159:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000100:00100000:3.0:1789427896.077589:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:0:x1876350857158912:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 101447us (101609us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789427896.077603:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 26 00000100:00100000:0.0:1789427896.087603:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.087852:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857159168 00000100:00100000:1.0:1789427896.087865:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857159168 00000100:00100000:1.0:1789427896.087944:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:1.0:1789427896.087956:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+25:10442:x1876350857159168:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789427896.088254:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+26:10442:x1876350857159168:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 299us (662us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789427896.088263:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:2.0:1789427896.098566:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427896.098601:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857159424 00000100:00100000:2.0:1789427896.098611:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857159424 00000100:00100000:2.0:1789427896.098657:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 77 00000100:00100000:2.0:1789427896.098665:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+26:10442:x1876350857159424:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789427896.098769:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+26:10442:x1876350857159424:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 104us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427896.098776:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 77 00000100:00100000:1.0:1789427896.104562:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427896.104642:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857159552 00000100:00100000:2.0:1789427896.104653:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857159552 00000100:00100000:2.0:1789427896.104717:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 78 00000100:00100000:2.0:1789427896.104727:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+26:10442:x1876350857159552:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427896.104756:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427896.104775:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3438b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a87ff expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.104868:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.104894:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.104908:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427896.104957:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427896.104975:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.105000:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3438b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ff expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.105018:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ff expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.105025:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:2.0:1789427896.105028:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789427896.105032:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401491600, rc 0) 00000100:00100000:2.0:1789427896.105088:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+27:10442:x1876350857159552:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 364us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427896.105095:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 78 00000100:00100000:2.0:1789427896.107962:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.108042:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857159680 00000100:00100000:3.0:1789427896.108053:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857159680 00000100:00100000:3.0:1789427896.108114:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 27 00000100:00100000:3.0:1789427896.108124:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857159680:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427896.108148:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427896.108172:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8806 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427896.108228:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa880b8, blocks: 0x1 00010000:00010000:3.0:1789427896.108247:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789427896.108251:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427896.108261:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8806 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.108279:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8806 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.108293:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789427896.108348:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857159680:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 225us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427896.108373:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 27 00000100:00100000:1.0:1789427896.111726:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427896.111822:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857159936 00000100:00100000:2.0:1789427896.111833:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857159936 00000100:00100000:2.0:1789427896.111900:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 79 00000100:00100000:2.0:1789427896.111910:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+27:10442:x1876350857159936:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789427896.112025:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+27:10442:x1876350857159936:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427896.112046:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 79 00000100:00100000:1.0:1789427896.117380:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.118561:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857160064 00000100:00100000:3.0:1789427896.118578:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857160064 00000100:00100000:3.0:1789427896.118658:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 28 00000100:00100000:3.0:1789427896.118671:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:10442:x1876350857160064:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427896.118694:0:8466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427896.118720:0:8466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a880d expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.118761:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8806 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.118772:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427896.118777:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427896.118782:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.118828:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8806 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.118857:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8806 expref: 7 pid: 6685 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427896.118875:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8466:1876350877107328:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427896.118996:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789427896.126554:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8466:1876350877107328:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427896.126609:0:8466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.126635:0:8466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030e00, rc 0) 00000100:00100000:3.0:1789427896.126727:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:10442:x1876350857160064:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 8057us (9356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427896.126738:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 28 00000100:00100000:3.0:1789427896.140434:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427896.140609:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857160192 00000100:00100000:2.0:1789427896.140624:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857160192 00010000:00010000:2.0:1789427896.140728:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8806 expref: 7 pid: 6685 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427896.140801:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:2.0:1789427896.140813:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857160192:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427896.140854:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427896.140886:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8806 expref: 7 pid: 6685 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.140902:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8806 expref: 7 pid: 6685 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.140934:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca3438c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8806 expref: 7 pid: 6685 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.140957:0:11166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427896.140962:0:11166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427896.140972:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 6 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.140984:0:11166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 6 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.141061:0:11166:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 6 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427896.141077:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11166:1876350877107456:192.168.201.55@tcp:105: 00000100:00100000:2.0:1789427896.141244:0:11166:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427896.161392:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427896.161450:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857160320 00000100:00100000:2.0:1789427896.161463:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857160320 00002000:00100000:2.0:1789427896.161539:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93341e20dc00 x1876350857160320/t0(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:142/0 lens 504/0 e 0 to 0 dl 1789427907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427896.161554:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93341e20dc00 with x1876350857160320 ext(0->8) 00002000:00010000:2.0:1789427896.161560:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93341e20dc00 00000100:00100000:2.0:1789427896.161596:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:2.0:1789427896.161609:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857160320:12345-192.168.201.55@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789427896.162795:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:691432fe-93d9-4afe-b1ac-013e2024784c+9:2356:x1876350857160320:12345-192.168.201.55@tcp:4:lhsmtool_posix.0 Request processed in 1180us (1414us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789427896.162808:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 0 00002000:00100000:2.0:1789427896.162829:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93341e20dc00 x1876350857160320/t4294967302(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:142/0 lens 504/448 e 0 to 0 dl 1789427907 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427896.162840:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93341e20dc00 with x1876350857160320 ext(0->8) 00002000:00010000:2.0:1789427896.162855:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93341e20dc00 00000100:00100000:2.0:1789427896.162921:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11166:1876350877107456:192.168.201.55@tcp:105: 00010000:00010000:2.0:1789427896.162959:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427896.162986:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857160192:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 22175us (22568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427896.162994:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:3.0:1789427896.182311:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427896.182594:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857160448 00000100:00100000:2.0:1789427896.182606:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857160448 00000100:00100000:2.0:1789427896.182672:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 80 00000100:00100000:2.0:1789427896.182682:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+27:10442:x1876350857160448:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789427896.255933:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+27:10442:x1876350857160448:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 Request processed in 73244us (73623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427896.255943:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 80 00000001:00080000:2.0:1789427896.255973:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:2.0:1789427896.255982:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1789427896.255990:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1789427896.255997:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789427896.256150:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789427896.256158:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789427896.258493:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877107584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789427896.258549:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427896.261853:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877107584 00000100:00100000:3.0:1789427896.261869:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877107584 00000100:00100000:3.0:1789427896.261931:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789427896.261938:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877107584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789427896.262083:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789427896.262086:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789427896 00002000:00010000:3.0:1789427896.262088:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789427896.262089:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789427896 -> 1789427896 00002000:00010000:3.0:1789427896.262091:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789427896.262156:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877107584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 218us (3606us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789427896.262161:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789427896.262196:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427896.263485:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000004:00080000:2.0:1789427896.263707:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93343b1b0000/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789427896.263714:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877107584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789427896.277316:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857160576 00000100:00100000:3.0:1789427896.277330:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857160576 00000100:00100000:3.0:1789427896.277579:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00100000:3.0:1789427896.277590:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857160576:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789427896.294307:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.294489:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.294562:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.294588:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857160704 00000100:00100000:1.0:1789427896.294597:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857160704 00000100:00100000:1.0:1789427896.294642:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 292 00000100:00100000:1.0:1789427896.294651:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857160704:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427896.294711:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2354:x1876350857160704:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427896.294718:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 292 00000100:00100000:3.0:1789427896.297121:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857160832 00000100:00100000:3.0:1789427896.297135:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857160832 00000100:00100000:3.0:1789427896.297213:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 66 00000100:00100000:3.0:1789427896.297223:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2354:x1876350857160832:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427896.298561:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2354:x1876350857160832:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 1333us (4257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427896.298573:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 66 00000100:00100000:3.0:1789427896.298602:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857160960 00000100:00100000:3.0:1789427896.298608:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857160960 00000100:00100000:3.0:1789427896.298649:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 146 00000100:00100000:3.0:1789427896.298656:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857160960:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427896.298687:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2354:x1876350857160960:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 32us (4125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427896.298693:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 146 00000100:00080000:2.0:1789427896.302323:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427896.302332:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427896.377573:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857160576:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 Request processed in 99976us (114084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427896.377587:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 30 00000001:00080000:3.0:1789427896.377626:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1789427896.377640:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1789427896.382549:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427896.392121:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857161216 00000100:00100000:0.0:1789427896.392136:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857161216 00000100:00100000:0.0:1789427896.392217:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 81 00000100:00100000:0.0:1789427896.392226:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+13:10442:x1876350857161216:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789427896.392276:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427896.392298:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca3438bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87ff expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.392312:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:0.0:1789427896.392316:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427896.392352:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.392365:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.392375:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789427896.392631:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002178d3e3 reply state 00000000aa6055ee transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427896.392641:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789427896.392746:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+14:10442:x1876350857161216:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 521us (10206us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789427896.392753:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 81 00000100:00100000:1.0:1789427896.399232:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00010000:00010000:1.0:1789427896.399257:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.399266:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.399272:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.399276:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.399280:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.399293:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.399305:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:1.0:1789427896.399307:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427896.399311:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.399315:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3438d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427896.399342:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857161344 00000100:00100000:1.0:1789427896.399350:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857161344 00000100:00100000:1.0:1789427896.399384:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 31 00000100:00100000:1.0:1789427896.399389:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857161344:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789427896.399579:0:8466:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789427896.399582:0:8466:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789427896 -> 1789427895 00002000:00010000:1.0:1789427896.399584:0:8466:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789427893 00002000:00010000:1.0:1789427896.399585:0:8466:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789427896 -> 1789427895 00002000:00010000:1.0:1789427896.399587:0:8466:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789427896.399627:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857161344:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 237us (404us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789427896.399632:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 31 00000100:00100000:0.0:1789427896.412470:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.412805:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857161600 00000100:00100000:3.0:1789427896.412814:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857161600 00000100:00100000:3.0:1789427896.412907:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 82 00000100:00100000:3.0:1789427896.412916:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+13:10442:x1876350857161600:12345-192.168.201.55@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789427896.412971:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.412993:0:8694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f1 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.413000:0:8694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.413042:0:8694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f1 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.413055:0:8694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f1 expref: 13 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427896.413069:0:8694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877107712:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427896.413230:0:8694:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427896.421647:0:8694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877107712:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427896.421673:0:8694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427896.421753:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427896.421777:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857161728 00000100:00100000:0.0:1789427896.421782:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857161728 00010000:00010000:0.0:1789427896.421821:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f1 expref: 14 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427896.421863:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 43 00000100:00100000:0.0:1789427896.421872:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+14:2357:x1876350857161728:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427896.421884:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427896.421889:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f1 expref: 14 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.421898:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f1 expref: 14 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.421914:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca34389a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f1 expref: 14 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.421927:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:0.0:1789427896.421930:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.421937:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.421942:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.421972:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427896.422009:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+13:2357:x1876350857161728:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 139us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427896.422024:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 43 00010000:00010000:1.0:1789427896.422305:0:8694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.422312:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.422353:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.422358:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.422363:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.422366:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.422370:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.422375:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.422381:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:1.0:1789427896.422383:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789427896.422386:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.422389:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427896.422420:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+12:10442:x1876350857161600:12345-192.168.201.55@tcp:55:lhsmtool_posix.0 Request processed in 9506us (9959us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789427896.422426:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 82 00000100:00100000:0.0:1789427896.443626:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.443706:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857161856 00000100:00100000:3.0:1789427896.443716:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857161856 00000100:00100000:3.0:1789427896.443770:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 32 00000100:00100000:3.0:1789427896.443777:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857161856:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789427896.443814:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.443833:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.443866:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427896.443870:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427896.443875:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.443905:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.443915:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 7 pid: 8466 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427896.443926:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876350877107840:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427896.443989:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789427896.448665:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427896.448701:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857161984 00000100:00100000:0.0:1789427896.448711:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857161984 00010000:00010000:0.0:1789427896.448755:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 8 pid: 8466 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427896.448799:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 44 00000100:00100000:0.0:1789427896.448808:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857161984:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427896.448831:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427896.448865:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 8 pid: 8466 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.448880:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 8 pid: 8466 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.448905:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427896.448910:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427896.448917:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.448928:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427896.448959:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427896.449001:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857161984:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 194us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427896.449008:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 44 00010000:00010000:2.0:1789427896.456398:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca3438cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a880d expref: 7 pid: 8466 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427896.456418:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876350877107840:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789427896.456441:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.456463:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.456468:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.456496:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.456501:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.456508:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.456512:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789427896.456515:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.456521:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.456534:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.456544:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cab73bb2/0x2bea1a57ca3438e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427896.456645:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857161856:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 Request processed in 12868us (13026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427896.456652:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 32 00000100:00100000:0.0:1789427896.477745:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.477851:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857162240 00000100:00100000:3.0:1789427896.477861:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857162240 00000100:00100000:3.0:1789427896.477923:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 83 00000100:00100000:3.0:1789427896.477933:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+12:10442:x1876350857162240:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789427896.478004:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.478029:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.478038:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.478269:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.478278:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f8 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.478284:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.478312:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f8 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.478321:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f8 expref: 13 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427896.478331:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877107968:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427896.478401:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e64b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427896.480879:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877107968:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427896.480906:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427896.483212:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.483491:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857162368 00000100:00100000:3.0:1789427896.483501:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857162368 00010000:00010000:3.0:1789427896.483538:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f8 expref: 14 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427896.483575:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 45 00000100:00100000:3.0:1789427896.483585:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+14:2357:x1876350857162368:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427896.483613:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427896.483620:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f8 expref: 14 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.483633:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f8 expref: 14 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.483653:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3438a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87f8 expref: 14 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.483671:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:3.0:1789427896.483678:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.483688:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.483695:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.483721:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427896.483769:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+13:2357:x1876350857162368:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 185us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427896.483777:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 45 00010000:00010000:3.0:1789427896.483996:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.484005:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427896.484225:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789427896.486602:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789427896.486641:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789427896.486710:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1876350877108096:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789427896.486761:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427896.486796:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbe000 going to sleep for 11 seconds 00000100:00100000:0.0:1789427896.487431:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877108096 00000100:00100000:0.0:1789427896.487440:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877108096 00000100:00100000:0.0:1789427896.487477:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789427896.487484:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1876350877108096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789427896.487544:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1876350877108096:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427896.487549:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789427896.488966:0:5836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789427896.488975:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93343b1b0000, transno 4294967303 00000100:00100000:3.0:1789427896.488987:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1876350877108096:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789427896.491723:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789427896.491800:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1876350877108224:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789427896.492085:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427896.492116:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427896.493255:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877108224 00000100:00100000:2.0:1789427896.493266:0:11961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877108224 00000100:00100000:2.0:1789427896.493314:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789427896.493320:0:11961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5836:x1876350877108224:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789427896.493909:0:11961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5836:x1876350877108224:12345-0@lo:1000:mdt00_002.0 Request processed in 586us (1821us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789427896.493915:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789427896.493994:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1876350877108224:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789427896.494038:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494046:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494052:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494055:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427896.494058:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494065:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494082:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93342215be00) 00010000:00010000:3.0:1789427896.494084:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427896.494088:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494092:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3438ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494117:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494120:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494124:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494127:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427896.494129:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494132:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494136:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93342215b700) 00010000:00010000:3.0:1789427896.494137:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427896.494139:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494142:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343823 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.494164:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.496693:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a87dc expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.496713:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.496756:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87dc expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.496771:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87dc expref: 16 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427896.496786:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877108352:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427896.496954:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427896.504006:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427896.504103:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857162496 00000100:00100000:2.0:1789427896.504113:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857162496 00010000:00010000:2.0:1789427896.504155:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87dc expref: 17 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427896.504219:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 46 00000100:00100000:2.0:1789427896.504229:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+17:2356:x1876350857162496:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427896.504255:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427896.504263:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87dc expref: 17 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.504276:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87dc expref: 17 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.504309:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93342215b700) 00010000:00010000:2.0:1789427896.504316:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.504326:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.504334:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.504492:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427896.504543:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+17:2356:x1876350857162496:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 314us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427896.504551:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 46 00010000:00010000:1.0:1789427896.505476:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34383f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a87dc expref: 16 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427896.505513:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877108352:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427896.505535:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505545:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505551:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505563:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505570:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505577:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505583:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.505587:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505595:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505607:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93342215b700) 00010000:00010000:1.0:1789427896.505610:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427896.505615:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505632:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca3438f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505645:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505651:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505657:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505661:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.505664:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505670:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505678:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93342215b700) 00010000:00010000:1.0:1789427896.505681:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789427896.505684:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.505689:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca3438e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427896.507715:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+15:10442:x1876350857162240:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 29774us (29969us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789427896.507729:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 83 00000020:00080000:1.0:1789427896.507741:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789427896.509850:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427896.509859:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427896.509895:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789427896.509902:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789427896.515269:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.515368:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857162752 00000100:00100000:3.0:1789427896.515379:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857162752 00000100:00100000:3.0:1789427896.515431:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:3.0:1789427896.515442:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+15:10442:x1876350857162752:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789427896.516083:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789427896.516209:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1789427896.516255:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.516276:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.516296:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.516305:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.516311:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.516317:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.516342:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789427896.516434:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+17:10442:x1876350857162752:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 992us (1170us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789427896.516443:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 20 00000020:00080000:3.0:1789427896.516449:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789427896.518545:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427896.518559:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.518569:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789427896.518573:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.518582:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.518598:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff933410b41b00) 00010000:00010000:1.0:1789427896.518601:0:7626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789427896.518606:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.518612:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3438fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.518630:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427896.518632:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427896.518644:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427896.521470:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789427896.545503:0:12003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427896.545515:0:12003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427896.545555:0:12003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789427896.545563:0:12003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427896.813699:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.813796:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857163008 00000100:00100000:3.0:1789427896.813806:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857163008 00000100:00100000:3.0:1789427896.813873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 84 00000100:00100000:3.0:1789427896.813884:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+17:10452:x1876350857163008:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427896.813908:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427896.813928:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8814 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.814015:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca34390a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.814028:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca34390a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.814047:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca34390a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427896.814059:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789427896.814337:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8814 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.814355:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca34390a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8814 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.814363:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:3.0:1789427896.814365:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789427896.814369:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031c00, rc 0) 00000100:00100000:3.0:1789427896.814431:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+19:10452:x1876350857163008:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 548us (739us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789427896.814448:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 84 00000100:00100000:0.0:1789427896.817936:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.818024:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857163136 00000100:00100000:1.0:1789427896.818035:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857163136 00000100:00100000:1.0:1789427896.818097:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 85 00000100:00100000:1.0:1789427896.818107:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+19:10452:x1876350857163136:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:1.0:1789427896.818211:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818227:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818247:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818262:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818267:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818271:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818474:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818482:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818489:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427896.818526:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818536:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818541:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818545:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818557:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.818560:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818566:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818574:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427896.818576:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427896.818580:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818585:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343918 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818593:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818597:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818601:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818603:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.818605:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818608:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818617:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914b00) 00010000:00010000:1.0:1789427896.818619:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427896.818621:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818624:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34391f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818633:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818637:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818640:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818643:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.818644:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818648:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818651:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914400) 00010000:00010000:1.0:1789427896.818653:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427896.818654:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.818657:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427896.818723:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+19:10452:x1876350857163136:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 617us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427896.818731:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 85 00000100:00100000:2.0:1789427896.873020:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.873145:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857163392 00000100:00100000:1.0:1789427896.873157:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857163392 00000100:00100000:1.0:1789427896.873257:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 86 00000100:00100000:1.0:1789427896.873267:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+19:10455:x1876350857163392:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427896.873288:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427896.873308:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34392d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a881b expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873393:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873407:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873417:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873430:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873436:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873442:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873716:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873725:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873732:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427896.873742:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789427896.873846:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873854:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873860:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873866:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.873870:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873878:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873889:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427896.873892:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427896.873896:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873912:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343934 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873925:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873930:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873936:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873941:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.873943:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873949:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873957:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914400) 00010000:00010000:1.0:1789427896.873959:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427896.873962:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.873967:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34393b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.874007:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34392d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a881b expref: 22 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.874020:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a881b expref: 21 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.874034:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427896.874036:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427896.874039:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701400, rc 0) 00000100:00100000:1.0:1789427896.874092:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+21:10455:x1876350857163392:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 827us (1084us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789427896.874099:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 86 00000100:00100000:2.0:1789427896.878076:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.878245:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857163520 00000100:00100000:1.0:1789427896.878254:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857163520 00000100:00100000:1.0:1789427896.878299:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 87 00000100:00100000:1.0:1789427896.878306:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:10455:x1876350857163520:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:1.0:1789427896.878367:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.878380:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.878389:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.878410:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.878414:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.878419:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.878422:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427896.878438:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.878444:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.878452:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427896.878455:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427896.878458:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.878462:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343950 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427896.878522:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:10455:x1876350857163520:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 217us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427896.878527:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 87 00000100:00100000:2.0:1789427896.881456:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.881556:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857163776 00000100:00100000:3.0:1789427896.881567:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857163776 00000100:00100000:2.0:1789427896.881687:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00100000:2.0:1789427896.881695:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419ad8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+21:10455:x1876350857163776:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427896.881915:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419ad8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:10455:x1876350857163776:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 220us (464us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789427896.881921:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00100000:2.0:1789427896.909361:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.909492:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857164032 00000100:00100000:1.0:1789427896.909503:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857164032 00000100:00100000:1.0:1789427896.909566:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 88 00000100:00100000:1.0:1789427896.909582:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+22:9983:x1876350857164032:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:1.0:1789427896.909606:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427896.909625:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343957 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8822 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.909727:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.909741:0:8694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a881b expref: 23 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.909759:0:8694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.909786:0:8694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a881b expref: 23 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.909795:0:8694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a881b expref: 23 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427896.909805:0:8694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877108480:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427896.909995:0:8694:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340605e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789427896.914786:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.915408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857164160 00000100:00100000:3.0:1789427896.915418:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857164160 00010000:00010000:3.0:1789427896.915454:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a881b expref: 24 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427896.915492:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00100000:3.0:1789427896.915502:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+24:2357:x1876350857164160:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427896.915518:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427896.915524:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a881b expref: 24 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.915555:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a881b expref: 24 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.915575:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:3.0:1789427896.915579:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.915586:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.915591:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.915605:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427896.915751:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343942 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a881b expref: 24 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427896.915768:0:8694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877108480:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427896.915784:0:8694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.915790:0:8694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.915794:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427896.915808:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789427896.915955:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343957 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8822 expref: 25 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.915976:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8822 expref: 24 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427896.915981:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427896.915983:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789427896.915984:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700a00, rc 0) 00000100:00100000:3.0:1789427896.916537:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+24:2357:x1876350857164160:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 1032us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427896.916546:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00100000:1.0:1789427896.917162:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+23:9983:x1876350857164032:12345-192.168.201.55@tcp:101:bash.0 Request processed in 7576us (7804us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789427896.917171:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 88 00000100:00100000:2.0:1789427896.919790:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.919998:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857164416 00000100:00100000:1.0:1789427896.920009:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857164416 00000100:00100000:3.0:1789427896.920166:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 89 00000100:00100000:3.0:1789427896.920395:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+23:9983:x1876350857164416:12345-192.168.201.55@tcp:36:bash.0 00010000:00010000:3.0:1789427896.920643:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.920657:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.920665:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427896.920703:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1789427896.920749:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000128fcec5 reply state 000000002ef4e7c4 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427896.920758:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789427896.920806:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1789427896.920993:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+27:9983:x1876350857164416:12345-192.168.201.55@tcp:36:bash.0 Request processed in 817us (1213us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789427896.920999:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 89 00000020:00080000:3.0:1789427896.921003:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789427896.925020:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00010000:00010000:3.0:1789427896.925076:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.925121:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.925131:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.925138:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427896.925143:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.925151:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.925168:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:3.0:1789427896.925171:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427896.925195:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.925202:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34396c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427896.925306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857164544 00000100:00100000:2.0:1789427896.925323:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857164544 00000100:00100000:2.0:1789427896.925452:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 90 00000100:00100000:2.0:1789427896.925462:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+26:9983:x1876350857164544:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:2.0:1789427896.925489:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427896.925506:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343973 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8829 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.925560:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343973 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8829 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.925569:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343973 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8829 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427896.925581:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:2.0:1789427896.925583:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427896.925585:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02b200, rc 0) 00000100:00100000:2.0:1789427896.925634:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+27:9983:x1876350857164544:12345-192.168.201.55@tcp:101:bash.0 Request processed in 173us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427896.925641:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 90 00000100:00100000:3.0:1789427896.929525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427896.929772:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857164672 00000100:00100000:1.0:1789427896.929782:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857164672 00000100:00100000:3.0:1789427896.929871:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:3.0:1789427896.929884:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:9983:x1876350857164672:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:3.0:1789427896.929902:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427896.929921:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8830 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427896.929942:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa880b7, atime: 0x6aa880b5, ctime: 0x6aa880b7, blocks: 0xb 00010000:00010000:3.0:1789427896.929960:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789427896.929964:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427896.929971:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8830 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.929985:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8830 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427896.929994:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789427896.930170:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:9983:x1876350857164672:12345-192.168.201.55@tcp:101:bash.0 Request processed in 288us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427896.930209:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:1.0:1789427896.934612:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427896.934843:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857164800 00000100:00100000:3.0:1789427896.934853:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857164800 00002000:00010000:3.0:1789427896.934891:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1789427896.934896:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933411ba8a80 with x1876350857164800 ext(0->18446744073709551615) 00002000:00010000:3.0:1789427896.934909:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff933411ba8a80. 00000100:00100000:3.0:1789427896.934965:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:3.0:1789427896.934975:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2354:x1876350857164800:12345-192.168.201.55@tcp:10:bash.0 00002000:00010000:3.0:1789427896.935448:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789427896.935452:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789427895 -> 1789427897 00002000:00010000:3.0:1789427896.935455:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789427893 -> 1789427893 00002000:00010000:3.0:1789427896.935457:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789427895 -> 1789427897 00002000:00010000:3.0:1789427896.935459:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789427896.935609:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2354:x1876350857164800:12345-192.168.201.55@tcp:10:bash.0 Request processed in 634us (1004us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789427896.935618:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 1 00002000:00010000:3.0:1789427896.935621:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1789427896.935624:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933411ba8a80 with x1876350857164800 ext(0->18446744073709551615) 00002000:00010000:3.0:1789427896.935629:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff933411ba8a80. 00000100:00100000:0.0:1789427897.003579:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.003764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857164928 00000100:00100000:1.0:1789427897.003773:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857164928 00000100:00100000:1.0:1789427897.003845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 91 00000100:00100000:1.0:1789427897.003856:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+27:10469:x1876350857164928:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:1.0:1789427897.003925:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.003943:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.003955:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.003972:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.003995:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004291:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004506:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004516:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004522:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427897.004559:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004570:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004576:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004583:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004589:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427897.004593:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004600:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004619:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427897.004622:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427897.004627:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004634:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343981 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004646:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004652:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004657:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004662:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427897.004664:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004670:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004677:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914400) 00010000:00010000:1.0:1789427897.004680:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427897.004682:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004688:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004711:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004717:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004728:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004733:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427897.004736:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004742:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004749:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427897.004752:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427897.004754:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.004759:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca34398f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789427897.004880:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427897.004959:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+27:10469:x1876350857164928:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 1103us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.004969:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 91 00000100:00100000:3.0:1789427897.058797:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.058973:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857165184 00000100:00100000:1.0:1789427897.058983:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857165184 00000100:00100000:1.0:1789427897.059037:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 92 00000100:00100000:1.0:1789427897.059061:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+27:10472:x1876350857165184:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427897.059095:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427897.059112:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343996 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8837 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059202:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059214:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059223:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059233:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059237:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059241:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059454:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3439ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059461:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3439ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059465:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3439ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427897.059479:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789427897.059559:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059565:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059569:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059573:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427897.059576:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059582:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059591:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427897.059593:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427897.059597:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059600:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34399d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059608:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059612:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059622:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059625:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427897.059627:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059630:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059634:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914400) 00010000:00010000:1.0:1789427897.059636:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427897.059637:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059640:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca3439a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.059669:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343996 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8837 expref: 30 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.060160:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3439ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8837 expref: 29 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.060285:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427897.060288:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789427897.060290:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700600, rc 0) 00000100:00100000:1.0:1789427897.060360:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+29:10472:x1876350857165184:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 1300us (1571us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789427897.060379:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 92 00000100:00100000:3.0:1789427897.065096:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.065203:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857165312 00000100:00100000:1.0:1789427897.065211:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857165312 00000100:00100000:1.0:1789427897.065253:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 93 00000100:00100000:1.0:1789427897.065261:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+29:10472:x1876350857165312:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:1.0:1789427897.065322:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.065343:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8822 expref: 29 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.065350:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.065376:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8822 expref: 29 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.065385:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8822 expref: 29 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427897.065396:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877108608:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427897.065469:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340605e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789427897.069633:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877108608:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427897.069659:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.070570:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.070825:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857165568 00000100:00100000:1.0:1789427897.070847:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857165568 00000100:00100000:1.0:1789427897.070958:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:1.0:1789427897.070969:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+30:5592:x1876350857165568:12345-192.168.201.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789427897.071349:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+31:5592:x1876350857165568:12345-192.168.201.55@tcp:35:ldlm_bl.0 Request processed in 381us (782us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789427897.071357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:2.0:1789427897.074605:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427897.074672:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857165696 00000100:00100000:0.0:1789427897.074683:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857165696 00010000:00010000:0.0:1789427897.074994:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8822 expref: 31 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427897.075048:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:0.0:1789427897.075059:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+31:2356:x1876350857165696:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427897.075075:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427897.075082:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8822 expref: 31 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.075095:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8822 expref: 31 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.075120:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca34395e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8822 expref: 31 pid: 8694 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.075138:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:0.0:1789427897.075143:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.075152:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.075159:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.075335:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427897.075417:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.075427:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.075460:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.075467:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.075474:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.075487:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427897.075492:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.075499:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.075509:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:3.0:1789427897.075512:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427897.075516:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.075521:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca3439b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427897.075683:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+30:2356:x1876350857165696:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 623us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427897.075691:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:3.0:1789427897.075753:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+29:10472:x1876350857165312:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 10491us (10687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.075762:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 93 00000100:00100000:3.0:1789427897.078919:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.079012:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857165952 00000100:00100000:2.0:1789427897.079022:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857165952 00000100:00100000:2.0:1789427897.079080:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 23 00000100:00100000:2.0:1789427897.079090:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+29:10472:x1876350857165952:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427897.079390:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+30:10472:x1876350857165952:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 300us (479us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789427897.079417:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 23 00000100:00100000:1.0:1789427897.161343:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.161432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857166208 00000100:00100000:2.0:1789427897.161442:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857166208 00000100:00100000:2.0:1789427897.161491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 94 00000100:00100000:2.0:1789427897.161498:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+30:10483:x1876350857166208:12345-192.168.201.55@tcp:101:cat.0 00010000:00010000:2.0:1789427897.161521:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427897.161540:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca3439c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a883e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.161598:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.161614:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.161626:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.161643:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.161650:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.161655:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.161911:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3439d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.161926:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3439d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.161931:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3439d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427897.161938:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789427897.162008:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162014:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162019:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162022:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427897.162026:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162031:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162039:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:2.0:1789427897.162041:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427897.162045:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162049:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3439c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162057:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162066:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162069:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162072:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427897.162074:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162077:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162081:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93342215bd00) 00010000:00010000:2.0:1789427897.162082:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427897.162084:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162087:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3439ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162117:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca3439c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a883e expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162126:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3439d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a883e expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.162130:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:2.0:1789427897.162132:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427897.162137:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02bc00, rc 0) 00000100:00100000:2.0:1789427897.162235:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+32:10483:x1876350857166208:12345-192.168.201.55@tcp:101:cat.0 Request processed in 736us (912us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789427897.162241:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 94 00000100:00100000:3.0:1789427897.166909:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.167027:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857166464 00000100:00100000:1.0:1789427897.167038:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857166464 00000100:00100000:1.0:1789427897.167085:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:1.0:1789427897.167092:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+32:10483:x1876350857166464:12345-192.168.201.55@tcp:35:cat.0 00000100:00100000:1.0:1789427897.167344:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+33:10483:x1876350857166464:12345-192.168.201.55@tcp:35:cat.0 Request processed in 252us (445us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789427897.167349:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:3.0:1789427897.199064:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427897.199155:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857166720 00000100:00100000:0.0:1789427897.199171:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857166720 00000100:00100000:0.0:1789427897.199241:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 95 00000100:00100000:0.0:1789427897.199249:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+33:10484:x1876350857166720:12345-192.168.201.55@tcp:36:rm.0 00010000:00010000:0.0:1789427897.199301:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789427897.199332:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca3439d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a883e expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199348:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3439ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8837 expref: 32 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199356:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343973 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8829 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199362:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff933408914b00) 00010000:00010000:0.0:1789427897.199370:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427897.199386:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199396:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199403:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199413:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199430:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199434:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199626:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199632:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.199636:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789427897.200073:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1789427897.200080:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352134904452ns, next at 353134902734ns, rc = 0 00010000:00010000:0.0:1789427897.200123:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.200131:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.200136:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.200141:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.200145:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.200156:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.200434:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427897.200440:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.200445:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789427897.200449:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.200455:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.200463:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9334083ca700) 00010000:00010000:1.0:1789427897.200464:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789427897.200467:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.200478:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427897.200480:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427897.200481:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427897.201073:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789427897.201081:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3439f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201111:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201118:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201123:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201126:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427897.201128:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201132:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201138:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9334083ca700) 00010000:00010000:0.0:1789427897.201140:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789427897.201142:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201145:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3439f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201159:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201197:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201201:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201204:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427897.201206:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201209:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201214:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:0.0:1789427897.201215:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427897.201217:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.201220:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3439e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789427897.201227:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c436289a reply state 00000000cb5f71f5 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427897.201234:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789427897.201310:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+32:10484:x1876350857166720:12345-192.168.201.55@tcp:36:rm.0 Request processed in 2059us (2251us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789427897.201317:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 95 00010000:00010000:1.0:1789427897.204286:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.204306:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.204314:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.204321:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427897.204325:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.204334:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.204349:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9334083cac00) 00010000:00010000:1.0:1789427897.204352:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427897.204356:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.204362:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3439ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.257321:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.257657:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857166976 00000100:00100000:2.0:1789427897.257666:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857166976 00000100:00100000:2.0:1789427897.257717:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 96 00000100:00100000:2.0:1789427897.257727:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+31:10490:x1876350857166976:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:2.0:1789427897.257752:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427897.257773:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca3439ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8845 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.257903:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.257915:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.257922:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.257931:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.257935:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.257940:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789427897.258437:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789427897.258570:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258578:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258584:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258606:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258611:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258615:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258618:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427897.258621:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258626:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258633:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:2.0:1789427897.258635:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427897.258639:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258642:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427897.258658:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e8e8724a reply state 0000000054940a45 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427897.258664:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789427897.258686:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca3439ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8845 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258696:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8845 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.258700:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215ba00) 00010000:00010000:2.0:1789427897.258702:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427897.258703:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02b200, rc 0) 00000100:00100000:2.0:1789427897.258757:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+34:10490:x1876350857166976:12345-192.168.201.55@tcp:101:bash.0 Request processed in 1032us (1445us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789427897.258765:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 96 00000100:00100000:3.0:1789427897.264796:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427897.264913:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857167104 00000100:00100000:0.0:1789427897.264925:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857167104 00000100:00100000:0.0:1789427897.265023:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:0.0:1789427897.265036:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857167104:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:0.0:1789427897.265062:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427897.265084:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a884c expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789427897.265116:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789427897.265135:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1789427897.265139:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427897.265149:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a884c expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.265168:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a884c expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.265230:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178400, rc 0) 00000100:00100000:0.0:1789427897.265283:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857167104:12345-192.168.201.55@tcp:101:bash.0 Request processed in 251us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427897.265291:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 34 00010000:00010000:1.0:1789427897.265477:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.265487:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.265501:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.265506:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427897.265510:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.265520:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.265534:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93342215bd00) 00010000:00010000:1.0:1789427897.265537:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427897.265542:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.265548:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343a0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.269382:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.269443:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857167232 00000100:00100000:1.0:1789427897.269456:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857167232 00000100:00100000:1.0:1789427897.269519:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 35 00000100:00100000:1.0:1789427897.269529:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:10490:x1876350857167232:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:1.0:1789427897.269549:0:8466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427897.269572:0:8466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8853 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.269633:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a884c expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.269656:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427897.269660:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427897.269665:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.269702:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a884c expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.269715:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a884c expref: 7 pid: 6684 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427897.269728:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8466:1876350877108736:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427897.269850:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340605e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789427897.272298:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8466:1876350877108736:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427897.272340:0:8466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.272364:0:8466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701400, rc 0) 00000100:00100000:1.0:1789427897.272442:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:10490:x1876350857167232:12345-192.168.201.55@tcp:101:bash.0 Request processed in 2912us (3064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.272452:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 35 00000100:00100000:0.0:1789427897.275373:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.276059:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857167360 00000100:00100000:2.0:1789427897.276069:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857167360 00010000:00010000:2.0:1789427897.276118:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a884c expref: 7 pid: 6684 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427897.276345:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:2.0:1789427897.276357:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857167360:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427897.276376:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427897.276544:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a884c expref: 7 pid: 6684 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.276580:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a884c expref: 7 pid: 6684 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.276604:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b33a504/0x2bea1a57ca343a22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a884c expref: 7 pid: 6684 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.276620:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427897.276623:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427897.276630:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 6 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.276636:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 6 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.276668:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 6 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427897.276679:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1876350877108864:192.168.201.55@tcp:105: 00000100:00100000:2.0:1789427897.276929:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e1ad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427897.279660:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410060a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5821:1876350877108864:192.168.201.55@tcp:105: 00010000:00010000:2.0:1789427897.279691:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427897.279754:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857167360:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 3397us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427897.279764:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:3.0:1789427897.282280:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.282381:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857167616 00000100:00100000:1.0:1789427897.282391:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857167616 00000100:00100000:1.0:1789427897.282449:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00100000:1.0:1789427897.282472:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+33:10490:x1876350857167616:12345-192.168.201.55@tcp:35:bash.0 00000100:00100000:1.0:1789427897.282755:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+34:10490:x1876350857167616:12345-192.168.201.55@tcp:35:bash.0 Request processed in 284us (485us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789427897.282763:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00100000:3.0:1789427897.471150:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.471715:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857167744 00000100:00100000:1.0:1789427897.471725:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857167744 00000100:00100000:1.0:1789427897.471787:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 97 00000100:00100000:1.0:1789427897.471798:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+34:10507:x1876350857167744:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427897.471833:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427897.471856:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343a30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a885a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.471922:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343a37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.471936:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.471948:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427897.471983:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789427897.471987:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427897.472014:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.472039:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a885a expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.472079:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a885a expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.472087:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427897.472090:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427897.472093:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701c00, rc 0) 00000100:00100000:1.0:1789427897.472156:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+35:10507:x1876350857167744:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 360us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.472164:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 97 00000100:00100000:2.0:1789427897.482295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.482596:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857168000 00000100:00100000:1.0:1789427897.482608:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857168000 00000100:00100000:1.0:1789427897.482671:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 98 00000100:00100000:1.0:1789427897.482683:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+35:10507:x1876350857168000:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427897.482706:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427897.482731:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343a3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8861 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.482861:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343a45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.482878:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.482892:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427897.482906:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789427897.483681:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343a3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8861 expref: 38 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.483704:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8861 expref: 37 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.483713:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215ba00) 00010000:00010000:1.0:1789427897.483715:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427897.483719:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700600, rc 0) 00000100:00100000:1.0:1789427897.484130:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+37:10507:x1876350857168000:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 1446us (1842us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789427897.484140:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 98 00000100:00100000:3.0:1789427897.491808:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427897.491899:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.491988:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857168384 00000100:00100000:2.0:1789427897.492014:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857168384 00000100:00100000:2.0:1789427897.492084:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:2.0:1789427897.492095:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+37:2356:x1876350857168384:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427897.492110:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427897.492134:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343a45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8861 expref: 37 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.492154:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215ba00) 00010000:00010000:2.0:1789427897.492159:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427897.492653:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857168256 00000100:00100000:1.0:1789427897.492659:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857168256 00000100:00100000:1.0:1789427897.492694:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 99 00000100:00100000:1.0:1789427897.492702:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+37:10507:x1876350857168256:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427897.492724:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427897.492741:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8868 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.492973:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343a5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.492989:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.493343:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427897.493368:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789427897.493497:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8868 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.493518:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343a5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8868 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.493527:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215ba00) 00010000:00010000:1.0:1789427897.493531:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789427897.493534:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700a00, rc 0) 00000100:00100000:2.0:1789427897.493767:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+39:2356:x1876350857168384:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 1671us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427897.493777:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:1.0:1789427897.495764:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+38:10507:x1876350857168256:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 3049us (3955us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789427897.495777:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 99 00000100:00100000:2.0:1789427897.505320:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427897.505491:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857168512 00000100:00100000:0.0:1789427897.505502:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857168512 00000100:00100000:0.0:1789427897.505560:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:0.0:1789427897.505570:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857168512:12345-192.168.201.55@tcp:1:lfs.0 00010000:00010000:0.0:1789427897.505614:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.505655:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 6 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.505664:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427897.505668:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427897.505672:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.505707:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 6 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.505721:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 6 pid: 8466 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427897.505735:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e074e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876350877108992:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427897.505838:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427897.510318:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.510496:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857168640 00000100:00100000:2.0:1789427897.510507:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857168640 00002000:00100000:2.0:1789427897.510565:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff933420e84700 x1876350857168640/t0(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:143/0 lens 504/0 e 0 to 0 dl 1789427908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427897.510577:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933420e84700 with x1876350857168640 ext(0->8) 00010000:00010000:2.0:1789427897.510587:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 7 pid: 8466 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.510604:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 7 pid: 8466 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427897.510612:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff933420e84700 00000100:00100000:2.0:1789427897.510665:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:2.0:1789427897.510675:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857168640:12345-192.168.201.55@tcp:4:lfs.0 00000100:00100000:2.0:1789427897.511165:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857168640:12345-192.168.201.55@tcp:4:lfs.0 Request processed in 490us (858us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789427897.511207:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 1 00002000:00100000:2.0:1789427897.511215:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff933420e84700 x1876350857168640/t4294967302(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:143/0 lens 504/448 e 0 to 0 dl 1789427908 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427897.511223:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933420e84700 with x1876350857168640 ext(0->8) 00010000:00010000:2.0:1789427897.511229:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 9 pid: 8466 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.511242:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 9 pid: 8466 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427897.511249:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff933420e84700 00000100:00100000:0.0:1789427897.511716:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e074e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876350877108992:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427897.511738:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427897.514081:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427897.514135:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857168768 00000100:00100000:3.0:1789427897.514146:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857168768 00010000:00010000:3.0:1789427897.514213:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 9 pid: 8466 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427897.514285:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00100000:2.0:1789427897.514296:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857168768:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427897.514308:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789427897.514327:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789427897.514329:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789427897 00002000:00010000:2.0:1789427897.514330:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789427897 00002000:00010000:2.0:1789427897.514332:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789427897 00010000:00010000:2.0:1789427897.514336:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 9 pid: 8466 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.514362:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 9 pid: 8466 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.514380:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343a29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8853 expref: 9 pid: 8466 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.514396:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427897.514399:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427897.514404:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.514410:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.514482:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427897.514541:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857168768:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 247us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427897.514548:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 50 00010000:00010000:0.0:1789427897.514729:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.514741:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.514772:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.514780:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.514789:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.514796:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789427897.514800:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.514809:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.515081:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.515089:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca343a68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427897.515299:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857168512:12345-192.168.201.55@tcp:1:lfs.0 Request processed in 9729us (9991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427897.515307:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:2.0:1789427897.520543:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.520650:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857169024 00000100:00100000:1.0:1789427897.520659:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857169024 00000100:00100000:1.0:1789427897.520784:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 26 00000100:00100000:1.0:1789427897.520794:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419ada450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+38:10507:x1876350857169024:12345-192.168.201.55@tcp:35:lfs.0 00000004:00010000:1.0:1789427897.520876:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343a5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8868 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427897.521247:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789427897.521297:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789427897.521599:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789427897.521645:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.521662:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8845 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.521682:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.521716:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8845 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.521731:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8845 expref: 42 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427897.521746:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1876350877109120:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427897.521846:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427897.524963:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1876350877109120:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427897.525014:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.530941:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427897.536199:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857169152 00000100:00100000:0.0:1789427897.536215:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857169152 00010000:00010000:1.0:1789427897.539271:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8845 expref: 43 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427897.539331:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:1.0:1789427897.539342:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+43:2357:x1876350857169152:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427897.539357:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427897.539364:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8845 expref: 43 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.539378:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8845 expref: 43 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.539400:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8845 expref: 43 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.539437:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215ba00) 00010000:00010000:1.0:1789427897.539443:0:11166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.539453:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.539461:0:11166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.539497:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427897.539570:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+42:2357:x1876350857169152:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 230us (8638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.539578:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 51 00010000:00010000:3.0:1789427897.540203:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.540213:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427897.540345:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789427897.540550:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1789427897.540659:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1876350877109248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789427897.540736:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427897.540834:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427897.543046:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877109248 00000100:00100000:1.0:1789427897.543064:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877109248 00000100:00100000:1.0:1789427897.543146:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789427897.543156:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1876350877109248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789427897.543292:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1876350877109248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 137us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.543299:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789427897.543331:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1876350877109248:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1789427897.543441:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789427897.543802:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789427897.543890:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1876350877109376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789427897.543928:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427897.543953:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053ba0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427897.543971:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877109376 00000100:00100000:2.0:1789427897.543975:0:11961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877109376 00000100:00100000:2.0:1789427897.544156:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789427897.544165:0:11961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5837:x1876350877109376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789427897.544358:0:11961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5837:x1876350877109376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 194us (427us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789427897.544371:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789427897.544441:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1876350877109376:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789427897.544493:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1789427897.544530:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.544540:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.544548:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.544554:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427897.544559:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.544567:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.544582:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215ba00) 00010000:00010000:3.0:1789427897.544586:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789427897.544590:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.544597:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343a6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427897.544743:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789427897.544845:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789427897.544855:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352479679225ns, next at 353479677290ns, rc = 0 00000001:00080000:3.0:1789427897.544860:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1789427897.544888:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215ba00) 00010000:00010000:3.0:1789427897.544891:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789427897.544902:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343a5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8868 expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.544986:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419ada450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+45:10507:x1876350857169024:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 24193us (24453us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1789427897.544993:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 26 00000020:00080000:3.0:1789427897.544997:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00010000:00010000:3.0:1789427897.548250:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427897.549862:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.549935:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857169280 00000100:00100000:2.0:1789427897.549947:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857169280 00000100:00100000:2.0:1789427897.550020:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 100 00000100:00100000:2.0:1789427897.550031:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+45:10507:x1876350857169280:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427897.550059:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427897.550083:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a886f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.550147:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a886f expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.550161:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a886f expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.550201:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:2.0:1789427897.550205:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427897.550209:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02be00, rc 0) 00000100:00100000:2.0:1789427897.550265:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+46:10507:x1876350857169280:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 236us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427897.550272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 100 00000100:00100000:1.0:1789427897.553556:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.553635:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857169536 00000100:00100000:2.0:1789427897.553645:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857169536 00000100:00100000:2.0:1789427897.553715:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 27 00000100:00100000:2.0:1789427897.553726:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+46:10507:x1876350857169536:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427897.553982:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+47:10507:x1876350857169536:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 258us (434us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789427897.554010:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 27 00000100:00100000:3.0:1789427897.696660:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427897.696763:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857169664 00000100:00100000:0.0:1789427897.696776:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857169664 00000100:00100000:0.0:1789427897.696918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 101 00000100:00100000:0.0:1789427897.696931:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+47:10517:x1876350857169664:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:0.0:1789427897.697039:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697058:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697069:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697084:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697092:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697099:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697266:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697275:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697282:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789427897.697372:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697385:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697391:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697396:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697400:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427897.697403:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697408:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697419:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:0.0:1789427897.697421:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427897.697425:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697429:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343a7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697441:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697445:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697454:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697458:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427897.697459:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697463:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697466:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9334083ca700) 00010000:00010000:0.0:1789427897.697468:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427897.697469:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697472:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343a84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697483:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697487:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697491:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697493:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427897.697495:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697504:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697509:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427897.697510:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427897.697512:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.697515:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343a8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427897.697609:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+47:10517:x1876350857169664:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 681us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427897.697616:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 101 00000100:00100000:0.0:1789427897.742899:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.743064:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857169920 00000100:00100000:2.0:1789427897.743076:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857169920 00000100:00100000:2.0:1789427897.743324:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 102 00000100:00100000:2.0:1789427897.743337:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+47:10520:x1876350857169920:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427897.743366:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427897.743392:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343a92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8876 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.743767:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.743953:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.743965:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744044:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744051:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744056:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744228:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744243:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744248:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427897.744258:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789427897.744418:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744426:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744434:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744441:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02b200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427897.744446:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744455:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744469:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:2.0:1789427897.744472:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427897.744477:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744482:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343a99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744493:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744708:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744716:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744721:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02ae00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427897.744724:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744731:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744739:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93342215b400) 00010000:00010000:2.0:1789427897.744741:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427897.744744:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744751:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744804:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343a92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8876 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744827:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8876 expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.744836:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:2.0:1789427897.744838:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427897.744848:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a400, rc 0) 00000100:00100000:2.0:1789427897.744970:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+49:10520:x1876350857169920:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 1635us (2084us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789427897.744988:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 102 00000100:00100000:3.0:1789427897.749691:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.750923:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857170048 00000100:00100000:1.0:1789427897.750941:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857170048 00000100:00100000:1.0:1789427897.751022:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 103 00000100:00100000:1.0:1789427897.751035:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+49:10520:x1876350857170048:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:1.0:1789427897.751128:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.751167:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.751199:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.751237:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.751243:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.751248:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.751252:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427897.751256:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.751262:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.751272:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:1.0:1789427897.751275:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427897.751280:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.751285:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427897.751380:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+49:10520:x1876350857170048:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 347us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.751396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 103 00000100:00100000:3.0:1789427897.753620:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427897.754089:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857170304 00000100:00100000:2.0:1789427897.754104:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857170304 00000100:00100000:2.0:1789427897.754207:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 28 00000100:00100000:2.0:1789427897.754220:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+49:10520:x1876350857170304:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427897.755963:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+50:10520:x1876350857170304:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 1737us (2347us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789427897.755992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 28 00000100:00100000:0.0:1789427897.840728:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427897.840847:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857170560 00000100:00100000:3.0:1789427897.840859:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857170560 00000100:00100000:3.0:1789427897.840927:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 104 00000100:00100000:3.0:1789427897.840937:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+50:10530:x1876350857170560:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:3.0:1789427897.840965:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427897.840969:0:8694:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789427897.841159:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a885a expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.841223:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:3.0:1789427897.841229:0:8694:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427897.841262:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343abc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a887d expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.841404:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.841430:0:8694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8876 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.841439:0:8694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.841473:0:8694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8876 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.841489:0:8694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8876 expref: 50 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.841503:0:8694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e86300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877109504:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427897.841601:0:8694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053ba9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427897.859010:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427897.859396:0:8694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e86300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877109504:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427897.859425:0:8694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427897.860113:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857170688 00000100:00100000:2.0:1789427897.860122:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857170688 00010000:00010000:2.0:1789427897.860207:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8876 expref: 51 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427897.860254:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 52 00000100:00100000:2.0:1789427897.860265:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+51:2357:x1876350857170688:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427897.860280:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427897.860287:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8876 expref: 51 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.860300:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8876 expref: 51 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.860333:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343aa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8876 expref: 51 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.860369:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:2.0:1789427897.860374:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.860384:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.860392:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427897.860427:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427897.860496:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+50:2357:x1876350857170688:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 232us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427897.860504:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 52 00010000:00010000:1.0:1789427897.861968:0:8694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.861982:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427897.862017:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789427897.862225:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343abc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a887d expref: 51 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.862245:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a887d expref: 50 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.862252:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:1.0:1789427897.862253:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789427897.862256:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030600, rc 0) 00000100:00100000:1.0:1789427897.862305:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+50:10530:x1876350857170560:12345-192.168.201.55@tcp:101:bash.0 Request processed in 21370us (21589us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789427897.862783:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 104 00000100:00100000:1.0:1789427897.867966:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427897.868059:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857170944 00000100:00100000:0.0:1789427897.868070:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857170944 00000100:00100000:0.0:1789427897.868134:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 105 00000100:00100000:0.0:1789427897.868145:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+50:10530:x1876350857170944:12345-192.168.201.55@tcp:36:bash.0 00010000:00010000:0.0:1789427897.868486:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.868504:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.868518:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427897.868595:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1789427897.868622:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d5a86ac7 reply state 000000005bc18087 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427897.868631:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789427897.870922:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+53:10530:x1876350857170944:12345-192.168.201.55@tcp:36:bash.0 Request processed in 2766us (2953us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789427897.870937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 105 00000020:00080000:0.0:1789427897.870944:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789427897.874837:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.874855:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.874863:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.874885:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427897.874890:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.874898:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.874915:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:1.0:1789427897.874919:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427897.874924:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.874930:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343ad1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427897.883657:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427897.883962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857171072 00000100:00100000:0.0:1789427897.883974:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857171072 00000100:00100000:0.0:1789427897.884093:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 106 00000100:00100000:0.0:1789427897.884104:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+52:10530:x1876350857171072:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:0.0:1789427897.884129:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427897.884150:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343ad8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8884 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.884302:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.884385:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a887d expref: 53 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.884395:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.884430:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a887d expref: 53 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427897.884463:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a887d expref: 53 pid: 8694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427897.884479:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e075c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877109632:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427897.884641:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427897.892290:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427897.892337:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857171200 00000100:00100000:1.0:1789427897.892347:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857171200 00010000:00010000:1.0:1789427897.892390:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a887d expref: 54 pid: 8694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427897.892425:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 53 00000100:00100000:1.0:1789427897.892435:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411baad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+54:2356:x1876350857171200:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427897.892451:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427897.892458:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a887d expref: 54 pid: 8694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.892472:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a887d expref: 54 pid: 8694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.892505:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:1.0:1789427897.892511:0:11166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.892521:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.892530:0:11166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427897.892552:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427897.892604:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411baad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+54:2356:x1876350857171200:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 170us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427897.892611:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 53 00010000:00010000:3.0:1789427897.893955:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343ac3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a887d expref: 53 pid: 8694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427897.893978:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e075c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877109632:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427897.894016:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.894025:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.894043:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427897.894094:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789427897.894098:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789427897.894119:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.894150:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343ad8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8884 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.894164:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8884 expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427897.894171:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:3.0:1789427897.894225:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427897.894229:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179800, rc 0) 00000100:00100000:3.0:1789427897.894286:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+52:10530:x1876350857171072:12345-192.168.201.55@tcp:101:bash.0 Request processed in 10184us (10640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427897.894294:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 106 00000100:00100000:1.0:1789427897.902789:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427897.902874:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857171456 00000100:00100000:3.0:1789427897.902886:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857171456 00000100:00100000:3.0:1789427897.902955:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:3.0:1789427897.902967:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+52:10530:x1876350857171456:12345-192.168.201.55@tcp:35:bash.0 00000100:00100000:3.0:1789427897.903266:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+53:10530:x1876350857171456:12345-192.168.201.55@tcp:35:bash.0 Request processed in 301us (485us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789427897.903274:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:1.0:1789427898.006334:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.006491:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857171584 00000100:00100000:0.0:1789427898.006502:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857171584 00000100:00100000:0.0:1789427898.006567:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 107 00000100:00100000:0.0:1789427898.006577:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+53:10536:x1876350857171584:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427898.006602:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427898.006623:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a888b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.006702:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343aed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.006717:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.006730:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427898.006767:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789427898.006771:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427898.006790:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.006828:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a888b expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.006862:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343aed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a888b expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.006871:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:0.0:1789427898.006874:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427898.006877:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178400, rc 0) 00000100:00100000:0.0:1789427898.006952:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+54:10536:x1876350857171584:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 376us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.006959:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 107 00000100:00100000:2.0:1789427898.013258:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427898.013554:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857171712 00000100:00100000:1.0:1789427898.013566:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857171712 00000100:00100000:1.0:1789427898.013629:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 108 00000100:00100000:1.0:1789427898.013641:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+54:10536:x1876350857171712:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427898.013662:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427898.013684:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343af4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8892 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.013751:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.013766:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.013793:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.013824:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.013832:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.013840:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.013948:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343b09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.013957:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.013965:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427898.014015:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789427898.014020:0:8694:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427898.014040:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014053:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014061:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014080:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014087:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014093:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427898.014097:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014105:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014118:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427898.014121:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427898.014127:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014133:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343afb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014147:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014152:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014158:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014163:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427898.014172:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014226:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014234:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff933408914400) 00010000:00010000:1.0:1789427898.014237:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427898.014240:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014246:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014278:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343af4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8892 expref: 56 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014292:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343b09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8892 expref: 55 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.014300:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:1.0:1789427898.014302:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427898.014304:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701c00, rc 0) 00000100:00100000:1.0:1789427898.014389:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+55:10536:x1876350857171712:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 749us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427898.014397:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 108 00000100:00100000:2.0:1789427898.017891:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.018006:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857171840 00000100:00100000:0.0:1789427898.018017:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857171840 00000100:00100000:0.0:1789427898.018088:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:0.0:1789427898.018099:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+55:2354:x1876350857171840:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427898.018115:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427898.018138:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343b09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8892 expref: 55 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.018159:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427898.018163:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427898.018255:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+54:2354:x1876350857171840:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 157us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.018262:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:2.0:1789427898.028840:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.028910:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857172096 00000100:00100000:0.0:1789427898.028921:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857172096 00000100:00100000:0.0:1789427898.028974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 109 00000100:00100000:0.0:1789427898.028991:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+54:10536:x1876350857172096:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427898.029035:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427898.029054:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8899 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.029149:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.029162:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8884 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.029171:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.029235:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8884 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.029248:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8884 expref: 55 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427898.029261:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e074000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877109760:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427898.029596:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be300 going to sleep for 11 seconds 00000100:00100000:0.0:1789427898.032149:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e074000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877109760:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427898.032214:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.041867:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427898.048929:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857172224 00000100:00100000:1.0:1789427898.048946:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857172224 00010000:00010000:1.0:1789427898.049008:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8884 expref: 56 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427898.049067:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 54 00000100:00100000:1.0:1789427898.049076:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+56:2356:x1876350857172224:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427898.049092:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427898.049099:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8884 expref: 56 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.049112:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8884 expref: 56 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.049136:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8884 expref: 56 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.049155:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:1.0:1789427898.049160:0:11166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.049170:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.049234:0:11166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.049262:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427898.049458:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+55:2356:x1876350857172224:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 382us (7599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427898.049466:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 54 00010000:00010000:2.0:1789427898.049738:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.049748:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427898.049768:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789427898.049928:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8899 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.049961:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8899 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.049970:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:2.0:1789427898.049973:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427898.049975:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179200, rc 0) 00000100:00100000:2.0:1789427898.050032:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+55:10536:x1876350857172096:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 21049us (21202us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789427898.050040:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 109 00000100:00100000:2.0:1789427898.060259:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.060840:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857172480 00000100:00100000:0.0:1789427898.060853:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857172480 00000100:00100000:0.0:1789427898.060931:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:0.0:1789427898.060957:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+55:10536:x1876350857172480:12345-192.168.201.55@tcp:103:lfs.0 00010000:00010000:0.0:1789427898.060975:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427898.061122:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343a76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a886f expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.061142:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427898.061148:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427898.061256:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+54:10536:x1876350857172480:12345-192.168.201.55@tcp:103:lfs.0 Request processed in 300us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.061263:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:1.0:1789427898.065377:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.065578:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857172608 00000100:00100000:3.0:1789427898.065590:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857172608 00000100:00100000:3.0:1789427898.065648:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 110 00000100:00100000:3.0:1789427898.065658:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+54:10536:x1876350857172608:12345-192.168.201.55@tcp:58:lfs.0 00010000:00010000:3.0:1789427898.065775:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.065792:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.065804:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427898.066096:0:8694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789427898.066220:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+54:10536:x1876350857172608:12345-192.168.201.55@tcp:58:lfs.0 Request processed in 562us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.066228:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 110 00000100:00100000:2.0:1789427898.070299:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427898.070406:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857172736 00000100:00100000:1.0:1789427898.070416:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857172736 00000100:00100000:1.0:1789427898.070478:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 111 00000100:00100000:1.0:1789427898.070489:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+54:10536:x1876350857172736:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427898.070511:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427898.070531:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88a0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.070591:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.070602:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b2c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a0 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.070624:0:5836:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.070638:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b2c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a0 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.070663:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:1.0:1789427898.070667:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789427898.070680:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b2c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a0 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.070689:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701600, rc 0) 00000100:00100000:1.0:1789427898.070759:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+55:10536:x1876350857172736:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 273us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427898.070767:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 111 00000004:00080000:0.0:1789427898.315423:0:6840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353250244216ns, next at 354250241921ns, rc = 0 00000100:00100000:2.0:1789427898.315502:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427898.315525:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877109888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427898.315625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427898.317110:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877109888 00000100:00100000:0.0:1789427898.317123:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877109888 00000100:00100000:0.0:1789427898.317213:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789427898.317224:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876350877109888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789427898.317260:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427898.317336:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876350877109888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.317343:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789427898.317370:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427898.317414:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877109888:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789427898.406754:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789427898.406770:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:1.0:1789427898.572649:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427898.572659:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427898.572704:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789427898.572712:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789427898.572855:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441985180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877110016:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789427898.572977:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340605e780 going to sleep for 11 seconds 00010000:00010000:1.0:1789427898.573035:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427898.582852:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427898.583271:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441985180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877110016:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789427898.583768:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857172864 00000100:00100000:3.0:1789427898.583778:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857172864 00000100:00100000:3.0:1789427898.583852:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 112 00000100:00100000:3.0:1789427898.583863:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+55:10537:x1876350857172864:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789427898.583895:0:8694:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789427898.584018:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+55:10537:x1876350857172864:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 156us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.584025:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 112 00000100:00100000:2.0:1789427898.601367:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427898.601483:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857172992 00000100:00100000:1.0:1789427898.601494:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857172992 00000100:00100000:1.0:1789427898.601590:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 113 00000100:00100000:1.0:1789427898.601920:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+55:10537:x1876350857172992:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789427898.601998:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.602014:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.602026:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609601:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609627:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609657:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609762:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609770:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609776:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427898.609883:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789427898.609888:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427898.609902:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609913:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609920:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609928:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609934:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427898.609939:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609946:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609968:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:0.0:1789427898.609971:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427898.609976:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.609983:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343b33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610000:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610006:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610012:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610016:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427898.610019:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610025:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610032:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9334083ca500) 00010000:00010000:0.0:1789427898.610034:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427898.610037:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610042:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610067:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610073:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610144:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610149:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427898.610152:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610158:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.610166:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427898.610168:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427898.610171:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.612049:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427898.612373:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+55:10537:x1876350857172992:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 Request processed in 10452us (11010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.612384:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 113 00000100:00100000:0.0:1789427898.617282:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.617403:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857173248 00000100:00100000:3.0:1789427898.617414:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857173248 00000100:00100000:3.0:1789427898.617472:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 114 00000100:00100000:3.0:1789427898.617482:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+55:10537:x1876350857173248:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427898.617527:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427898.617549:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343b48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88a7 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.617653:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618049:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618062:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427898.618133:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789427898.618265:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618273:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618279:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618285:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427898.618290:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618298:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618310:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:3.0:1789427898.618320:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789427898.618326:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618332:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343b4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618378:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343b48 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a7 expref: 57 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618389:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:3.0:1789427898.618391:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427898.618395:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343b48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a7 expref: 57 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.618404:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030400, rc 0) 00000100:00100000:3.0:1789427898.618552:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+56:10537:x1876350857173248:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 1071us (1279us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1789427898.618561:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 114 00000100:00100000:2.0:1789427898.624319:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.624417:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857173376 00000100:00100000:0.0:1789427898.624427:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857173376 00000100:00100000:0.0:1789427898.624499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 115 00000100:00100000:0.0:1789427898.624508:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+56:10537:x1876350857173376:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789427898.624544:0:5834:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789427898.624656:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+56:10537:x1876350857173376:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 148us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.624674:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 115 00000100:00100000:2.0:1789427898.639894:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427898.640072:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857173632 00000100:00100000:1.0:1789427898.640083:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857173632 00000100:00100000:1.0:1789427898.640147:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 116 00000100:00100000:1.0:1789427898.640158:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+56:10537:x1876350857173632:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427898.640239:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427898.640261:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789427898.640431:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343aed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a888b expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.640452:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:1.0:1789427898.640457:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427898.640471:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343b5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427898.641033:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789427898.646361:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.646386:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.646400:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.646469:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343b5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ae expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.646492:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ae expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.646501:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca500) 00010000:00010000:0.0:1789427898.646504:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427898.646507:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178a00, rc 0) 00000100:00100000:0.0:1789427898.646569:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+57:10537:x1876350857173632:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 6412us (6687us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789427898.646578:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 116 00000100:00100000:2.0:1789427898.660685:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.661454:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857173888 00000100:00100000:0.0:1789427898.661489:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857173888 00000100:00100000:0.0:1789427898.661581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 117 00000100:00100000:0.0:1789427898.661595:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+57:10537:x1876350857173888:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789427898.661661:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427898.661692:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343b64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ae expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.661711:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca500) 00010000:00010000:0.0:1789427898.661721:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427898.661742:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.661755:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.661765:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663378:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663401:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663411:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663483:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663491:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663512:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663518:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427898.663522:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663530:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663542:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:0.0:1789427898.663545:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427898.663549:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663555:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343b72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663569:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663575:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663580:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663585:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427898.663587:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663605:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663613:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb2717169 (ffff9334083ca700) 00010000:00010000:0.0:1789427898.663615:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427898.663618:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.663624:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb2717169 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427898.663730:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+56:10537:x1876350857173888:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 2134us (3059us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789427898.663738:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 117 00000100:00100000:3.0:1789427898.681748:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.681937:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857174016 00000100:00100000:0.0:1789427898.681949:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857174016 00000100:00100000:0.0:1789427898.682013:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 118 00000100:00100000:0.0:1789427898.682025:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+56:10537:x1876350857174016:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427898.682045:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427898.682069:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88b5 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.682105:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.682119:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.682130:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.682290:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88b5 expref: 58 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.682309:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88b5 expref: 57 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.682317:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427898.682320:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789427898.682325:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179c00, rc 0) 00000100:00100000:0.0:1789427898.682389:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+57:10537:x1876350857174016:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 366us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.682396:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 118 00000100:00100000:2.0:1789427898.688793:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427898.689116:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857174272 00000100:00100000:1.0:1789427898.690599:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857174272 00000100:00100000:1.0:1789427898.690705:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 119 00000100:00100000:1.0:1789427898.690718:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+57:10537:x1876350857174272:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789427898.690842:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.690865:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.690881:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789427898.691302:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1789427898.692980:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002c2659e7 reply state 00000000c3ae069d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427898.693007:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427898.694167:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+59:10537:x1876350857174272:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 3437us (5370us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789427898.694225:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 119 00000100:00100000:2.0:1789427898.705075:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.705245:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857174400 00000100:00100000:0.0:1789427898.705265:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857174400 00000100:00100000:0.0:1789427898.705347:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 120 00000100:00100000:0.0:1789427898.705359:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+59:10537:x1876350857174400:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427898.705389:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427898.705410:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88bc expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.705480:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88bc expref: 60 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.705507:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88bc expref: 60 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.705554:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427898.705557:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427898.705561:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179600, rc 0) 00000100:00100000:0.0:1789427898.705630:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+60:10537:x1876350857174400:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 273us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.705637:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 120 00010000:00010000:1.0:1789427898.705757:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.705773:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.705782:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.705789:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427898.705795:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.705814:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.705835:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:1.0:1789427898.705838:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789427898.705844:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.705852:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343b8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.709629:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.709742:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857174528 00000100:00100000:3.0:1789427898.709757:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857174528 00000100:00100000:3.0:1789427898.709867:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00080000:0.0:1789427898.709883:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427898.709884:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857174528:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789427898.710828:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857174528:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 921us (1184us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789427898.710842:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00100000:2.0:1789427898.727532:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.728111:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857174784 00000100:00100000:3.0:1789427898.728243:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857174784 00000100:00100000:0.0:1789427898.728570:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00100000:0.0:1789427898.728599:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+59:10537:x1876350857174784:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789427898.729027:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+60:10537:x1876350857174784:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 441us (1509us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789427898.729035:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00100000:2.0:1789427898.738057:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.738133:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857175040 00000100:00100000:0.0:1789427898.738144:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857175040 00000100:00100000:0.0:1789427898.738229:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 121 00000100:00100000:0.0:1789427898.738243:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+60:10537:x1876350857175040:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789427898.738373:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+60:10537:x1876350857175040:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 134us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.738382:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 121 00000100:00100000:2.0:1789427898.743311:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427898.743362:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857175168 00000100:00100000:0.0:1789427898.743374:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857175168 00000100:00100000:0.0:1789427898.743433:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 122 00000100:00100000:0.0:1789427898.743442:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+60:10537:x1876350857175168:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427898.743478:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427898.743508:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88c3 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.743598:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343ba3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.743613:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.743624:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427898.743662:0:8694:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427898.743682:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.743706:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343b9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88c3 expref: 62 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.743724:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88c3 expref: 61 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.743731:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427898.743734:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789427898.743738:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179e00, rc 0) 00000100:00100000:0.0:1789427898.743926:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+61:10537:x1876350857175168:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 484us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427898.743934:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 122 00000100:00100000:1.0:1789427898.770053:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427898.771779:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857175296 00000100:00100000:2.0:1789427898.771819:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857175296 00000100:00100000:2.0:1789427898.771936:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 38 00000100:00100000:2.0:1789427898.771949:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:2356:x1876350857175296:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427898.771971:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427898.771995:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88ca expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427898.772026:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa880ba, blocks: 0x1 00010000:00010000:2.0:1789427898.772049:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1789427898.772053:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427898.772063:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ca expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.772095:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ca expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427898.772112:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02bc00, rc 0) 00000100:00100000:2.0:1789427898.772221:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+10:2356:x1876350857175296:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 275us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.772228:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 38 00000100:00100000:1.0:1789427898.774932:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.775333:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857175552 00000100:00100000:3.0:1789427898.775348:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857175552 00000100:00100000:3.0:1789427898.775445:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 123 00000100:00100000:3.0:1789427898.775459:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+61:10537:x1876350857175552:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789427898.775614:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+61:10537:x1876350857175552:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 158us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.775622:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 123 00000100:00100000:3.0:1789427898.779631:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427898.779869:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857175680 00000100:00100000:1.0:1789427898.779884:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857175680 00000100:00100000:1.0:1789427898.780282:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 39 00000100:00100000:1.0:1789427898.780307:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+10:10537:x1876350857175680:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427898.780354:0:8466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427898.780382:0:8466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88d1 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.780436:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ca expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.780446:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427898.780451:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427898.780457:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 11 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.780503:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ca expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.780519:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ca expref: 11 pid: 6682 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427898.780540:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441984a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8466:1876350877110144:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427898.780671:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be000 going to sleep for 11 seconds 00000100:00100000:1.0:1789427898.788710:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.788770:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857175808 00000100:00100000:3.0:1789427898.788783:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857175808 00010000:00010000:3.0:1789427898.788852:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ca expref: 12 pid: 6682 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.788865:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441984a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8466:1876350877110144:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789427898.788917:0:8466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 12 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.788918:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 55 00000100:00100000:3.0:1789427898.788933:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+12:2357:x1876350857175808:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427898.788943:0:8466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700c00, rc 0) 00010000:00010000:3.0:1789427898.788954:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427898.788987:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ca expref: 12 pid: 6682 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.789004:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ca expref: 12 pid: 6682 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427898.789025:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+12:10537:x1876350857175680:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 8730us (9407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.789052:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 39 00010000:00010000:3.0:1789427898.789223:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038715819/0x2bea1a57ca343baa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ca expref: 11 pid: 6682 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.789250:0:11166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427898.789254:0:11166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427898.789261:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 10 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.789269:0:11166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 10 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.789308:0:11166:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 10 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.789325:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e85f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11166:1876350877110272:192.168.201.55@tcp:105: 00000100:00100000:3.0:1789427898.789388:0:11166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053ba3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427898.794361:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e85f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11166:1876350877110272:192.168.201.55@tcp:105: 00010000:00010000:3.0:1789427898.794389:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427898.794454:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+10:2357:x1876350857175808:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 5524us (5758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.794465:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 55 00000100:00100000:1.0:1789427898.804585:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.804841:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857175936 00000100:00100000:3.0:1789427898.804967:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857175936 00002000:00100000:3.0:1789427898.805037:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff933441984e00 x1876350857175936/t0(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:144/0 lens 504/0 e 0 to 0 dl 1789427909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789427898.805049:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933441984e00 with x1876350857175936 ext(0->12) 00002000:00010000:3.0:1789427898.805056:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff933441984e00 00000100:00100000:3.0:1789427898.805120:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:3.0:1789427898.805132:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+10:2357:x1876350857175936:12345-192.168.201.55@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789427898.805811:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+12:2357:x1876350857175936:12345-192.168.201.55@tcp:4:lhsmtool_posix.0 Request processed in 668us (1222us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789427898.805821:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 2 00002000:00100000:3.0:1789427898.805830:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff933441984e00 x1876350857175936/t4294967308(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:144/0 lens 504/448 e 0 to 0 dl 1789427909 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789427898.805838:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933441984e00 with x1876350857175936 ext(0->12) 00002000:00010000:3.0:1789427898.805842:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff933441984e00 00000100:00100000:1.0:1789427898.811983:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.812624:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857176064 00000100:00100000:3.0:1789427898.812639:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857176064 00000100:00100000:3.0:1789427898.812783:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 124 00000100:00100000:3.0:1789427898.812805:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+61:10537:x1876350857176064:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789427898.880528:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1789427898.880546:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1789427898.880561:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1789427898.880631:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789427898.880648:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff933433d05c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789427898.880653:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e8bf600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff933433d05480 00000020:00080000:3.0:1789427898.880656:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e8bff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93343b6df400 00000020:00080000:3.0:1789427898.880692:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff933420fbe000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789427898.880695:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e8bf900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff933420fbe9c0 00000020:00080000:3.0:1789427898.880697:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e8bfc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93342024bc00 00000100:00100000:2.0:1789427898.880812:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+15:10537:x1876350857176064:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 Request processed in 67998us (68826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.880827:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 124 00000020:00080000:3.0:1789427898.880936:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1789427898.881344:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877110400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789427898.881416:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789427898.881448:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789427898.881489:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877110528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789427898.881524:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877110400 00000100:00100000:0.0:1789427898.881534:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877110400 00000100:00100000:1.0:1789427898.881576:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427898.881598:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877110528 00000100:00100000:0.0:1789427898.881604:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877110528 00000100:00100000:0.0:1789427898.881648:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789427898.881659:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1876350877110400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789427898.881694:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1789427898.881730:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.881758:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8830 expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.881769:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789427898.881774:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427898.881780:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.881825:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8830 expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.881842:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8830 expref: 11 pid: 6685 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427898.881857:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e076300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876350877110656:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427898.881933:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340605e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789427898.881961:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789427898.881971:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877110528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789427898.881989:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1789427898.882024:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa880b9, atime: 0x6aa880b9, ctime: 0x6aa880b9, blocks: 0xb 00010000:00010000:0.0:1789427898.882031:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882042:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1789427898.882045:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427898.882052:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882070:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882082:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882091:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882114:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789427898.882825:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877110528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 851us (1247us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789427898.882837:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789427898.882880:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427898.882888:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882900:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789427898.882907:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882919:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882946:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882956:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca343bbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427898.882985:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427898.882987:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427898.882989:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427898.883003:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789427898.883014:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:1.0:1789427898.883032:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93343b0a2680, transno 4294967301 00000004:00080000:1.0:1789427898.883050:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1789427898.883065:0:3298:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93341e076680 x1876350877110528/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789427914 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789427898.883079:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93341e076680/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789427898.883084:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877110528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789427898.883749:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427898.884150:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857176192 00000100:00100000:2.0:1789427898.884162:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857176192 00000100:00100000:2.0:1789427898.884373:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:2.0:1789427898.884384:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+12:2357:x1876350857176192:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789427898.890139:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.890572:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e076300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876350877110656:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427898.891554:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.891606:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857176320 00000100:00100000:3.0:1789427898.891617:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857176320 00010000:00010000:3.0:1789427898.891660:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8830 expref: 13 pid: 6685 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.891696:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 56 00000100:00100000:3.0:1789427898.891706:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+13:2357:x1876350857176320:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427898.893210:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427898.893226:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8830 expref: 13 pid: 6685 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.893247:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8830 expref: 13 pid: 6685 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.893601:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34397a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8830 expref: 13 pid: 6685 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.893623:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427898.893628:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427898.893636:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.893666:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.893704:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427898.893814:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+12:2357:x1876350857176320:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 2105us (3696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427898.893824:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 56 00010000:00010000:1.0:1789427898.894004:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.894026:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.894044:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.894054:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427898.894274:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789427898.894842:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427898.894857:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.894870:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789427898.894875:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.894886:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.894906:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.894913:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca343bb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.894934:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427898.894949:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427898.894951:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427898.895424:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1876350877110400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13761us (14003us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789427898.895438:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1789427898.896966:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff933420e85f80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789427898.896995:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877110400:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789427898.989536:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789427898.989665:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1789427898.990246:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+10:2357:x1876350857176192:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 Request processed in 105856us (106491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427898.990259:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 42 00000001:00080000:0.0:1789427898.990763:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1789427898.996291:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427898.996437:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857176576 00000100:00100000:3.0:1789427898.996449:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857176576 00000100:00100000:3.0:1789427898.996515:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 125 00000100:00100000:3.0:1789427898.996525:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+15:10537:x1876350857176576:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789427898.996578:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427898.996607:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343ba3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88c3 expref: 15 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.996628:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:3.0:1789427898.996633:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427898.996662:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.996675:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427898.996685:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427898.997165:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000041a1742a reply state 0000000068a47c24 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427898.997600:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427898.998642:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+16:10537:x1876350857176576:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 2107us (2351us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789427898.998654:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 125 00000100:00100000:1.0:1789427899.005770:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427899.005891:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857176704 00000100:00100000:0.0:1789427899.005917:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857176704 00000100:00100000:0.0:1789427899.005986:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 43 00000100:00100000:0.0:1789427899.005996:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857176704:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789427899.006249:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789427899.006253:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789427898 00002000:00010000:0.0:1789427899.006255:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789427897 00002000:00010000:0.0:1789427899.006257:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789427898 -> 1789427898 00002000:00010000:0.0:1789427899.006260:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1789427899.006766:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.006780:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.006817:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.006824:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427899.006828:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.006836:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.006851:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:3.0:1789427899.006854:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427899.006859:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.006866:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343bc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.008101:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857176704:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 2093us (2327us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789427899.008115:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 43 00000100:00100000:1.0:1789427899.011689:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427899.012131:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857176960 00000100:00100000:0.0:1789427899.012142:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857176960 00000100:00100000:1.0:1789427899.012547:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 126 00000100:00100000:1.0:1789427899.012558:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+15:10537:x1876350857176960:12345-192.168.201.55@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789427899.012637:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.012657:0:8694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88b5 expref: 15 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.012667:0:8694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.012720:0:8694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88b5 expref: 15 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.012734:0:8694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88b5 expref: 15 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427899.012748:0:8694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441986300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877110784:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427899.012878:0:8694:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be180 going to sleep for 11 seconds 00000100:00100000:0.0:1789427899.017345:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427899.018314:0:8694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441986300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877110784:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427899.018345:0:8694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.018562:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857177088 00000100:00100000:3.0:1789427899.018570:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857177088 00010000:00010000:3.0:1789427899.018614:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88b5 expref: 16 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.018660:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 57 00000100:00100000:3.0:1789427899.018670:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+16:2357:x1876350857177088:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427899.018684:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427899.018691:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88b5 expref: 16 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.018742:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88b5 expref: 16 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.018768:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343b87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88b5 expref: 16 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.018800:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:3.0:1789427899.018806:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.018824:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.018832:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.018863:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427899.018928:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+15:2357:x1876350857177088:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 259us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.018935:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 57 00010000:00010000:0.0:1789427899.020573:0:8694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.020591:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.020625:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.020632:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.020639:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.020645:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427899.020668:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.020676:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.020691:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427899.020695:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789427899.020699:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.020717:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343bcd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.021219:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+14:10537:x1876350857176960:12345-192.168.201.55@tcp:55:lhsmtool_posix.0 Request processed in 8654us (9533us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789427899.021229:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 126 00000100:00100000:0.0:1789427899.027270:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427899.027965:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857177216 00000100:00100000:1.0:1789427899.027976:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857177216 00000100:00100000:1.0:1789427899.028048:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 44 00000100:00100000:1.0:1789427899.028058:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857177216:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789427899.028128:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.028151:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.028160:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427899.028165:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427899.028170:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.028234:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 7 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.028249:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 7 pid: 8466 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427899.028265:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441986300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876350877110912:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427899.028369:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be180 going to sleep for 11 seconds 00000100:00080000:2.0:1789427899.028714:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427899.038759:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427899.038932:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441986300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876350877110912:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427899.038958:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.039214:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857177344 00000100:00100000:0.0:1789427899.039223:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857177344 00010000:00010000:0.0:1789427899.039264:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 8 pid: 8466 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427899.039985:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 58 00000100:00100000:1.0:1789427899.039999:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857177344:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427899.040014:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427899.040038:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 8 pid: 8466 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.040071:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 8 pid: 8466 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.040096:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca343bb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d1 expref: 8 pid: 8466 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.040115:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427899.040119:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427899.040124:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.040135:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.040209:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427899.040263:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857177344:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 268us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427899.040271:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 58 00010000:00010000:2.0:1789427899.040348:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.040359:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.040381:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.040389:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.040406:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.040413:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701000 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789427899.040417:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.040425:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.040436:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.040443:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa2a3ca0/0x2bea1a57ca343bd4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.040486:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857177216:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 Request processed in 12430us (13228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427899.040494:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 44 00000100:00100000:1.0:1789427899.046101:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427899.046741:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857177600 00000100:00100000:0.0:1789427899.046754:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857177600 00000100:00100000:0.0:1789427899.046867:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 127 00000100:00100000:0.0:1789427899.046878:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+14:10537:x1876350857177600:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789427899.046961:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.047020:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.047229:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.047516:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.047531:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88bc expref: 15 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.047540:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.047578:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88bc expref: 15 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.047592:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88bc expref: 15 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.047605:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e075880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877111040:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427899.047692:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff933414c070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427899.051625:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427899.051669:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857177728 00000100:00100000:0.0:1789427899.051680:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857177728 00010000:00010000:0.0:1789427899.051725:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88bc expref: 16 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.051788:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 59 00000100:00100000:0.0:1789427899.051895:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+16:2356:x1876350857177728:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427899.051916:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427899.051927:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88bc expref: 16 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.051941:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88bc expref: 16 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.052127:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427899.052134:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.052145:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.052152:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.052202:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427899.052286:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+16:2356:x1876350857177728:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 475us (677us total) trans 0 rc 0/0 00010000:00010000:1.0:1789427899.052441:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343b95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a88bc expref: 16 pid: 8694 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427899.052457:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e075880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877111040:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427899.052478:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.052500:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427899.052506:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427899.054398:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789427899.054645:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789427899.054692:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789427899.054805:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441985500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5834:1876350877111168:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789427899.054882:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427899.055412:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 59 00000100:00100000:0.0:1789427899.055459:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877111168 00000100:00100000:0.0:1789427899.055466:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877111168 00000100:00100000:0.0:1789427899.055504:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427899.055511:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1876350877111168:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789427899.056553:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427899.060503:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1876350877111168:12345-0@lo:1000:mdt00_000.0 Request processed in 4980us (5609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.060517:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789427899.061267:0:5834:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789427899.061277:0:5834:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1789427899.061394:0:5834:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff933420e85f80 x1876350877110400/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789427914 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427899.061410:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441985500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5834:1876350877111168:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789427899.062548:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789427899.062640:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441985500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5834:1876350877111296:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789427899.062701:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427899.062864:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e8be480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427899.063713:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877111296 00000100:00100000:2.0:1789427899.063788:0:11961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877111296 00000100:00100000:2.0:1789427899.063900:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789427899.063910:0:11961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5834:x1876350877111296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789427899.064238:0:11961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5834:x1876350877111296:12345-0@lo:1000:mdt00_000.0 Request processed in 328us (1536us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789427899.064262:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789427899.064522:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441985500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5834:1876350877111296:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789427899.064564:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064574:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064582:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064587:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427899.064592:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064599:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064613:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427899.064616:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427899.064621:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064626:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343be2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064654:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064672:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064678:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064682:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427899.064685:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064691:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064699:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427899.064702:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427899.064708:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064720:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064788:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.064832:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.064846:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e077480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877111424:192.168.201.55@tcp:105: 00000100:00100000:0.0:1789427899.064974:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c307a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427899.072501:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427899.072613:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e077480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877111424:192.168.201.55@tcp:105: 00010000:00010000:2.0:1789427899.072642:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072652:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343b25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072684:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072699:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072713:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072724:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072730:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072737:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072743:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02b200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427899.072746:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072754:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072782:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:2.0:1789427899.072785:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427899.072789:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072807:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343be9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072817:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072824:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072830:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072835:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427899.072838:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072844:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072851:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:2.0:1789427899.072854:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789427899.072856:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.072862:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343bdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.073137:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+18:10537:x1876350857177600:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 26259us (27044us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789427899.073148:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 127 00000020:00080000:2.0:1789427899.073155:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789427899.074126:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427899.074134:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427899.074678:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789427899.074686:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427899.077005:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857177856 00000100:00100000:3.0:1789427899.077027:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857177856 00000100:00100000:3.0:1789427899.077103:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 31 00000100:00100000:3.0:1789427899.077132:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+18:10536:x1876350857177856:12345-192.168.201.55@tcp:49:lfs.0 00000100:00100000:3.0:1789427899.077308:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+18:10536:x1876350857177856:12345-192.168.201.55@tcp:49:lfs.0 Request processed in 179us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.077316:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 31 00000100:00100000:1.0:1789427899.077723:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427899.080226:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857178112 00000100:00100000:3.0:1789427899.080242:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857178112 00000100:00100000:3.0:1789427899.080317:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 32 00000100:00100000:3.0:1789427899.080328:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419adb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+18:10537:x1876350857178112:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789427899.087044:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427899.087340:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857178368 00000100:00100000:0.0:1789427899.087350:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857178368 00000100:00100000:0.0:1789427899.087402:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 128 00000100:00100000:0.0:1789427899.087412:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+20:10536:x1876350857178368:12345-192.168.201.55@tcp:58:lfs.0 00000004:00080000:2.0:1789427899.090117:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789427899.090195:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789427899.090263:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.090280:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.090302:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.090312:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.090319:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.090325:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.090348:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789427899.090458:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419adb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+21:10537:x1876350857178112:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 10128us (12732us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789427899.090467:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 32 00000020:00080000:2.0:1789427899.090473:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1789427899.091362:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789427899.091439:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+20:10536:x1876350857178368:12345-192.168.201.55@tcp:58:lfs.0 Request processed in 4025us (4402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.091449:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 128 00010000:00010000:3.0:1789427899.092263:0:7625:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427899.092275:0:7625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.092284:0:7625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789427899.092296:0:7625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.092305:0:7625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.092321:0:7625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93342215b500) 00010000:00010000:3.0:1789427899.092324:0:7625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789427899.092329:0:7625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.092334:0:7625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343bf0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427899.092352:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427899.092365:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427899.092367:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427899.178015:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427899.178200:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857178496 00000100:00100000:2.0:1789427899.178211:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857178496 00000100:00100000:2.0:1789427899.178278:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 129 00000100:00100000:2.0:1789427899.178297:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+20:10539:x1876350857178496:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427899.178326:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427899.178346:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343bf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.178409:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.178424:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.178435:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.178451:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.178458:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.178465:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.178731:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.178743:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8899 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.178765:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.179551:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8899 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427899.179581:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8899 expref: 21 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427899.179598:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e8d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877111552:192.168.201.55@tcp:104: 00000100:00100000:2.0:1789427899.179775:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e1adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427899.183656:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427899.183800:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857178752 00000100:00100000:0.0:1789427899.183828:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857178752 00000100:00100000:0.0:1789427899.183889:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:0.0:1789427899.183902:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+22:5592:x1876350857178752:12345-192.168.201.55@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789427899.184241:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+23:5592:x1876350857178752:12345-192.168.201.55@tcp:35:ldlm_bl.0 Request processed in 341us (596us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789427899.184249:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:1.0:1789427899.184968:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e8d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877111552:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427899.184998:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427899.188257:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427899.188336:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857178880 00000100:00100000:0.0:1789427899.188348:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857178880 00010000:00010000:0.0:1789427899.188392:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8899 expref: 23 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427899.188437:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 60 00000100:00100000:0.0:1789427899.188449:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+23:2357:x1876350857178880:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427899.188463:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427899.188470:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8899 expref: 23 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.188506:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8899 expref: 23 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.188530:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343b17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8899 expref: 23 pid: 5834 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.188547:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427899.188553:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.188562:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.188571:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.188601:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427899.188982:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:2357:x1876350857178880:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 535us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.188989:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 60 00010000:00010000:0.0:1789427899.189050:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189059:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427899.189102:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789427899.189107:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427899.189126:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189149:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189160:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189167:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189203:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189211:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427899.189215:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189223:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189232:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:0.0:1789427899.189235:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.189239:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189245:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343bfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189258:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189264:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189277:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189282:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427899.189378:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189385:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189393:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93342215b400) 00010000:00010000:0.0:1789427899.189395:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427899.189399:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189404:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343c05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189442:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343bf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d8 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189457:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d8 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427899.189465:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427899.189468:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427899.189470:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02b200, rc 0) 00000100:00100000:0.0:1789427899.191208:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+21:10539:x1876350857178496:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 12908us (13187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427899.191238:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 129 00000100:00100000:1.0:1789427899.337538:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877111936:0@lo:400:kworker.0 00000100:00100000:1.0:1789427899.337617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427899.337682:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789427899.337689:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877111808:0@lo:400:kworker.0 00000100:00100000:1.0:1789427899.337713:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427899.337728:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877112320:0@lo:400:kworker.0 00000100:00100000:1.0:1789427899.337751:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427899.337889:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877111680:0@lo:400:kworker.0 00000100:00100000:3.0:1789427899.337923:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427899.337949:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877112192:0@lo:400:kworker.0 00000100:00100000:3.0:1789427899.337981:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427899.338001:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427899.338007:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877112064:0@lo:400:kworker.0 00000100:00100000:3.0:1789427899.338037:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877111680 00000100:00100000:3.0:1789427899.338044:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877111680 00000100:00100000:3.0:1789427899.338092:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789427899.338101:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877111680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427899.338154:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877111680:12345-0@lo:400:kworker.0 Request processed in 54us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.338161:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789427899.338224:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877111936 00000100:00100000:3.0:1789427899.338228:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877111936 00000100:00100000:3.0:1789427899.338277:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877111808 00000100:00100000:3.0:1789427899.338281:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877111808 00000100:00100000:3.0:1789427899.338303:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877112192 00000100:00100000:3.0:1789427899.338306:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877112192 00000100:00100000:3.0:1789427899.338323:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789427899.338328:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877111936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427899.338362:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877111936:12345-0@lo:400:kworker.0 Request processed in 33us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.338368:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789427899.338396:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789427899.338402:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877111808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427899.338430:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877111808:12345-0@lo:400:kworker.0 Request processed in 29us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.338437:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789427899.338448:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789427899.338454:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877112192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427899.338481:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877112192:12345-0@lo:400:kworker.0 Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427899.338487:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1789427899.338508:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427899.339011:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877111936:0@lo:400:kworker.0 00000100:00100000:1.0:1789427899.339037:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877111808:0@lo:400:kworker.0 00000100:00100000:3.0:1789427899.339686:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427899.339699:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877112448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427899.339750:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427899.339807:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427899.339981:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877112448 00000100:00100000:1.0:1789427899.339988:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877112448 00000100:00100000:1.0:1789427899.340040:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789427899.340049:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876350877112448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427899.340087:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427899.340131:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876350877112448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427899.340138:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789427899.340160:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427899.340213:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877112448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427899.340921:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877111680:0@lo:400:kworker.0 00000100:00100000:3.0:1789427899.340936:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877112192:0@lo:400:kworker.0 00000100:00100000:0.0:1789427899.344150:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877112320 00000100:00100000:0.0:1789427899.344167:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877112320 00000100:00100000:0.0:1789427899.349562:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877112064 00000100:00100000:0.0:1789427899.349578:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877112064 00000100:00100000:1.0:1789427899.350771:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789427899.350799:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876350877112320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427899.350927:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876350877112320:12345-0@lo:400:kworker.0 Request processed in 144us (13173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427899.350935:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789427899.350955:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789427899.351527:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876350877112064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427899.351575:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876350877112064:12345-0@lo:400:kworker.0 Request processed in 303us (11768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427899.351582:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789427899.351625:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877112064:0@lo:400:kworker.0 00000100:00100000:2.0:1789427899.353171:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877112320:0@lo:400:kworker.0 00010000:00010000:3.0:1789427899.598525:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789427899.973340:0:12056:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427899.973347:0:12056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427899.973378:0:12056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789427899.973382:0:12056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789427900.105487:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427900.105498:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427900.105549:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789427900.105558:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789427900.105695:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e075f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877112576:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789427900.105963:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410c53900 going to sleep for 11 seconds 00000100:00100000:1.0:1789427900.119624:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427900.119740:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e075f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877112576:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789427900.121432:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857179008 00000100:00100000:3.0:1789427900.121450:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857179008 00000100:00100000:3.0:1789427900.121527:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 130 00000100:00100000:3.0:1789427900.121538:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:10551:x1876350857179008:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789427900.121578:0:5834:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789427900.121706:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:10551:x1876350857179008:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 169us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427900.121734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 130 00000100:00100000:2.0:1789427900.127983:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427900.128035:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857179264 00000100:00100000:0.0:1789427900.128046:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857179264 00000100:00100000:0.0:1789427900.128110:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 131 00000100:00100000:0.0:1789427900.128121:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+21:10551:x1876350857179264:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427900.128139:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427900.128161:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.128453:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343c1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.128469:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.128483:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427900.128512:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789427900.128649:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88df expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.128668:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88df expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.128675:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427900.128678:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427900.128681:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178a00, rc 0) 00000100:00100000:0.0:1789427900.128752:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+23:10551:x1876350857179264:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 632us (778us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789427900.128759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 131 00000100:00100000:0.0:1789427900.133488:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427900.133576:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857179392 00000100:00100000:2.0:1789427900.133585:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857179392 00000100:00100000:2.0:1789427900.133641:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:2.0:1789427900.133648:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+23:2357:x1876350857179392:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427900.133661:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427900.133680:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343c1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88df expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427900.133696:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:2.0:1789427900.133700:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427900.133746:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+22:2357:x1876350857179392:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 98us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427900.133762:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:1.0:1789427900.136480:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427900.136529:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857179648 00000100:00100000:0.0:1789427900.136540:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857179648 00000100:00100000:0.0:1789427900.136635:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 132 00000100:00100000:0.0:1789427900.136644:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+22:10551:x1876350857179648:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789427900.136717:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.136735:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.136745:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.136939:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.136945:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.136949:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.136953:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427900.136966:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.136972:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.136981:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427900.136983:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789427900.136986:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427900.136990:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343c28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427900.137121:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+23:10551:x1876350857179648:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 477us (647us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789427900.137129:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 132 00000040:00080000:1.0:1789427900.137209:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427900.137213:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427900.137955:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789427900.137964:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789427900.139067:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427900.139143:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857179904 00000100:00100000:0.0:1789427900.139151:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857179904 00000100:00100000:0.0:1789427900.139222:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:0.0:1789427900.139243:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+23:10551:x1876350857179904:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789427900.139451:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+24:10551:x1876350857179904:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 208us (390us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789427900.139460:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 34 00010000:00010000:0.0:1789427900.629857:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427901.409353:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427901.409389:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427901.409412:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427901.409425:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427901.409440:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427901.409462:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857180416 00000100:00100000:2.0:1789427901.409471:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857180416 00000100:00100000:2.0:1789427901.409513:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857180288 00000100:00100000:2.0:1789427901.409515:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857180288 00000100:00100000:2.0:1789427901.409530:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 69 00000100:00100000:2.0:1789427901.409537:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857180416:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427901.409608:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857180416:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 70us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427901.409615:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 69 00000100:00100000:2.0:1789427901.409632:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 70 00000100:00100000:2.0:1789427901.409639:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857180288:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427901.409658:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857180288:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 21us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427901.409662:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 70 00000100:00100000:2.0:1789427901.409674:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857180032 00000100:00100000:2.0:1789427901.409677:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857180032 00000100:00100000:2.0:1789427901.409693:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 294 00000100:00100000:2.0:1789427901.409697:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857180032:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427901.409713:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857180032:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 16us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427901.409727:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 294 00000100:00100000:2.0:1789427901.409765:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857180160 00000100:00100000:2.0:1789427901.409769:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857180160 00000100:00100000:2.0:1789427901.409797:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 150 00000100:00100000:2.0:1789427901.409804:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+24:2357:x1876350857180160:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427901.409830:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+24:2357:x1876350857180160:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427901.409835:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 150 00000100:00100000:2.0:1789427901.409841:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857180544 00000100:00100000:2.0:1789427901.409843:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857180544 00000100:00100000:2.0:1789427901.409858:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 151 00000100:00100000:2.0:1789427901.409862:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857180544:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427901.409876:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857180544:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 14us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427901.409879:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 151 00000100:00080000:2.0:1789427901.409890:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427901.409893:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427901.409895:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789427901.642560:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789427901.954475:0:12109:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427901.954485:0:12109:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427901.954530:0:12109:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789427901.954537:0:12109:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789427902.339315:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427902.339406:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857180800 00000100:00100000:2.0:1789427902.339417:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857180800 00000100:00100000:2.0:1789427902.339473:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 133 00000100:00100000:2.0:1789427902.339483:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+24:10571:x1876350857180800:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427902.339507:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427902.339528:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343c2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427902.339656:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343c36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427902.339673:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343c36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427902.339688:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343c36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427902.339699:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789427902.339844:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02ae00/0x2bea1a57ca343c2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88e6 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427902.339863:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343c36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88e6 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427902.339872:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:2.0:1789427902.339875:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789427902.339879:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02bc00, rc 0) 00000100:00100000:2.0:1789427902.339957:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+26:10571:x1876350857180800:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 474us (651us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789427902.339965:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 133 00000100:00100000:2.0:1789427902.347107:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427902.347229:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857180928 00000100:00100000:0.0:1789427902.347249:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857180928 00000100:00100000:0.0:1789427902.347311:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 134 00000100:00100000:0.0:1789427902.347323:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+26:10571:x1876350857180928:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:0.0:1789427902.347393:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.347411:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.347423:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.347450:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.347457:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.347463:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.347480:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427902.347485:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.347492:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.347505:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427902.347508:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427902.347513:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427902.347519:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427902.347604:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+26:10571:x1876350857180928:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 284us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427902.347612:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 134 00000100:00100000:0.0:1789427902.506218:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427902.517456:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857181056 00000100:00100000:2.0:1789427902.517475:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857181056 00000100:00100000:2.0:1789427902.517556:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 45 00000100:00100000:2.0:1789427902.517567:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857181056:12345-192.168.201.55@tcp:101:cat.0 00010000:00010000:2.0:1789427902.517603:0:8466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427902.517626:0:8466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000057119fb/0x2bea1a57ca343c4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88ed expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427902.517653:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa880ba, atime: 0x6aa880b9, ctime: 0x6aa880ba, blocks: 0xb 00010000:00010000:2.0:1789427902.517675:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1789427902.517679:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427902.517689:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000057119fb/0x2bea1a57ca343c4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ed expref: 7 pid: 8466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427902.517707:0:8466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000057119fb/0x2bea1a57ca343c4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ed expref: 7 pid: 8466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427902.517720:0:8466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02ae00, rc 0) 00000100:00100000:2.0:1789427902.518305:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857181056:12345-192.168.201.55@tcp:101:cat.0 Request processed in 734us (12093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427902.518313:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 45 00000100:00100000:1.0:1789427902.528817:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427902.528897:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857181184 00000100:00100000:3.0:1789427902.528916:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857181184 00002000:00100000:3.0:1789427902.528968:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff933441985180 x1876350857181184/t0(0) o3->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:148/0 lens 488/0 e 0 to 0 dl 1789427913 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789427902.528981:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933441985180 with x1876350857181184 ext(0->4095) 00002000:00010000:3.0:1789427902.528987:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff933441985180 00000100:00100000:3.0:1789427902.529020:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:3.0:1789427902.529029:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857181184:12345-192.168.201.55@tcp:3:cat.0 00000100:00100000:3.0:1789427902.529277:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857181184:12345-192.168.201.55@tcp:3:cat.0 Request processed in 248us (469us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789427902.529286:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 3 00002000:00100000:3.0:1789427902.529292:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff933441985180 x1876350857181184/t0(0) o3->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:148/0 lens 488/4536 e 0 to 0 dl 1789427913 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789427902.529301:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff933441985180 with x1876350857181184 ext(0->4095) 00002000:00010000:3.0:1789427902.529304:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff933441985180 00010000:00010000:3.0:1789427902.665749:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789427903.433884:0:6840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358368704616ns, next at 359368701828ns, rc = 0 00000100:00100000:3.0:1789427903.433981:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789427903.434008:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877112704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427903.434083:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427903.434489:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877112704 00000100:00100000:1.0:1789427903.434498:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877112704 00000100:00100000:1.0:1789427903.434585:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789427903.434597:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876350877112704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427903.434634:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427903.434706:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876350877112704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427903.434724:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789427903.434786:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877112704:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789427903.435370:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789427903.537016:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1789427903.690814:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789427904.042604:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1789427904.042642:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93341e8be900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789427904.042648:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e1aac00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93341e8be180 00000020:00080000:0.0:1789427904.042651:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e1aa500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93341dc1d800 00000004:00080000:0.0:1789427904.042669:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1789427904.042679:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1789427904.042694:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789427904.042713:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789427904.042853:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1789427904.043320:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877112832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789427904.043388:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427904.050403:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877112832 00000100:00100000:3.0:1789427904.050419:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877112832 00000100:00100000:2.0:1789427904.050593:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789427904.050605:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876350877112832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789427904.050833:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789427904.050838:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789427898 -> 1789427898 00002000:00010000:2.0:1789427904.050841:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1789427897 -> 1789427897 00002000:00010000:2.0:1789427904.050843:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789427898 -> 1789427898 00002000:00010000:2.0:1789427904.050855:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789427904.050933:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3299:x1876350877112832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 331us (7544us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789427904.050942:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1789427904.051420:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93341e077100/2, rc 0, transno 4294967312 00000100:00100000:1.0:1789427904.051428:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877112832:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789427904.136857:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789427904.136944:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1789427904.136964:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000040:00080000:1.0:1789427904.266944:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427904.266953:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427904.266991:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789427904.266997:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789427904.458463:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877112960:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.458537:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427904.458589:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877113472:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.458618:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427904.458628:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877112960 00000100:00100000:0.0:1789427904.458637:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877112960 00000100:00100000:1.0:1789427904.458644:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789427904.458649:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877113088:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.458673:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427904.458680:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789427904.458688:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877113600:0@lo:400:kworker.0 00000100:00100000:0.0:1789427904.458688:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877112960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.458723:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427904.458739:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877112960:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427904.458746:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789427904.458750:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877112960:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.458778:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877113216:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.458816:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427904.458843:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877113728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427904.459162:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877113472 00000100:00100000:0.0:1789427904.459168:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877113472 00000100:00100000:0.0:1789427904.459232:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877113088 00000100:00100000:0.0:1789427904.459236:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877113088 00000100:00100000:0.0:1789427904.459249:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877113216 00000100:00100000:0.0:1789427904.459251:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877113216 00000100:00100000:0.0:1789427904.459265:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789427904.459273:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877113472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427904.459310:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877113472:12345-0@lo:400:kworker.0 Request processed in 39us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427904.459316:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789427904.459327:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789427904.459332:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877113088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427904.459356:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877113088:12345-0@lo:400:kworker.0 Request processed in 24us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427904.459361:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789427904.459372:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789427904.459377:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877113216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427904.459403:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877113216:12345-0@lo:400:kworker.0 Request processed in 25us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427904.459420:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789427904.459437:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789427904.459437:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427904.459475:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877113216:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.459486:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427904.459493:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877113344:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.459517:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427904.459553:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877113600 00000100:00100000:1.0:1789427904.459556:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877113600 00000100:00100000:1.0:1789427904.459586:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877113344 00000100:00100000:1.0:1789427904.459588:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877113344 00000100:00100000:1.0:1789427904.459605:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789427904.459611:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877113600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.459640:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877113600:12345-0@lo:400:kworker.0 Request processed in 30us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427904.459646:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789427904.459657:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789427904.459662:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877113344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.459688:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877113344:12345-0@lo:400:kworker.0 Request processed in 26us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427904.459704:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789427904.459722:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877113728 00000100:00100000:1.0:1789427904.459726:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877113728 00000100:00100000:1.0:1789427904.459748:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789427904.459754:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877113728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427904.459781:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427904.459817:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877113728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427904.459823:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1789427904.461745:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427904.461925:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877113088:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.461940:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789427904.461945:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93341e076680, transno 4294967304 00000100:00100000:1.0:1789427904.461969:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877113600:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.461982:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877113472:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.462026:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789427904.462030:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff933420e85f80, transno 4294967309 00000004:00080000:1.0:1789427904.462042:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1789427904.462063:0:3298:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93341e077100 x1876350877112832/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789427920 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789427904.462073:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877113344:0@lo:400:kworker.0 00000100:00100000:1.0:1789427904.462518:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877113728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789427904.713383:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427905.737348:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427906.523207:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427906.523261:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427906.523304:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427906.523320:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857181696 00000100:00100000:3.0:1789427906.523349:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857181696 00000100:00100000:1.0:1789427906.523360:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427906.523398:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427906.523441:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857181312 00000100:00100000:3.0:1789427906.523443:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857181568 00000100:00100000:1.0:1789427906.523450:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857181312 00000100:00100000:3.0:1789427906.523451:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857181568 00000100:00100000:3.0:1789427906.523526:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 73 00000100:00100000:1.0:1789427906.523533:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 296 00000100:00100000:3.0:1789427906.523544:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411baad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857181696:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427906.523553:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857181312:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427906.523801:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411baad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857181696:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 260us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427906.523810:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 73 00000100:00100000:3.0:1789427906.523831:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 74 00000100:00100000:3.0:1789427906.523838:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857181568:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427906.523867:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857181568:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427906.523872:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 74 00000100:00080000:3.0:1789427906.523886:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427906.523891:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427906.524072:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857181312:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 525us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427906.524082:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 296 00000100:00100000:0.0:1789427906.527235:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857181440 00000100:00100000:0.0:1789427906.527257:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857181440 00000100:00100000:3.0:1789427906.527280:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857181824 00000100:00100000:3.0:1789427906.527297:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857181824 00000100:00100000:0.0:1789427906.527358:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 155 00000100:00100000:0.0:1789427906.527374:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+13:2356:x1876350857181440:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427906.527454:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 156 00000100:00100000:3.0:1789427906.527467:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857181824:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427906.527484:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+13:2356:x1876350857181440:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 112us (4318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427906.527495:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 155 00000100:00100000:3.0:1789427906.527544:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857181824:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 79us (4143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427906.527555:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 156 00000100:00080000:3.0:1789427906.527592:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789427906.761379:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427907.788591:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427908.560579:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877113856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427908.560692:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427908.562701:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877113856 00000100:00100000:2.0:1789427908.562716:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877113856 00000100:00100000:2.0:1789427908.562818:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789427908.562831:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877113856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427908.562883:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427908.562997:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877113856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427908.563004:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789427908.563226:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877113856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789427908.565737:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789427908.810645:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427908.933094:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427908.933730:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857181952 00000100:00100000:2.0:1789427908.933744:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857181952 00000100:00100000:2.0:1789427908.933831:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 135 00000100:00100000:2.0:1789427908.933842:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+13:10224:x1876350857181952:12345-192.168.201.55@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789427908.933962:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+13:10224:x1876350857181952:12345-192.168.201.55@tcp:60:lhsmtool_posix.0 Request processed in 122us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427908.933972:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 135 00000100:00080000:1.0:1789427908.934709:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427908.953807:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427908.954459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857182208 00000100:00100000:3.0:1789427908.954493:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857182208 00000100:00100000:3.0:1789427908.954570:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 35 00000100:00100000:3.0:1789427908.954583:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+13:10224:x1876350857182208:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789427908.955048:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+14:10224:x1876350857182208:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 464us (1254us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789427908.955059:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 35 00000001:00080000:3.0:1789427909.102945:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:0.0:1789427909.103299:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789427909.103344:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789427909.103355:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1789427909.103390:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000100:00100000:1.0:1789427909.580006:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877114240:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580107:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427909.580159:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877113984:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580204:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427909.580211:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877114368:0@lo:400:kworker.0 00000100:00100000:2.0:1789427909.580226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427909.580239:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427909.580254:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877114496:0@lo:400:kworker.0 00000100:00100000:2.0:1789427909.580277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427909.580277:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877114240 00000100:00100000:1.0:1789427909.580287:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877114240 00000100:00100000:2.0:1789427909.580294:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789427909.580320:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877114112:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580355:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877114496 00000100:00100000:1.0:1789427909.580359:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877114496 00000100:00100000:2.0:1789427909.580362:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427909.580377:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877114112 00000100:00100000:2.0:1789427909.580378:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877114624:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580380:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877114112 00000100:00100000:1.0:1789427909.580397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789427909.580398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427909.580407:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877114240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427909.580424:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877113984 00000100:00100000:2.0:1789427909.580428:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877113984 00000100:00100000:2.0:1789427909.580461:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789427909.580464:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877114240:12345-0@lo:400:kworker.0 Request processed in 59us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427909.580468:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877113984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580472:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789427909.580492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789427909.580501:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877113984:12345-0@lo:400:kworker.0 Request processed in 34us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427909.580507:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789427909.580512:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877114496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580549:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877114496:12345-0@lo:400:kworker.0 Request processed in 51us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427909.580554:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877113984:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580554:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789427909.580567:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877114496:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580567:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789427909.580572:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877114112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580596:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877114112:12345-0@lo:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427909.580610:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789427909.580613:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877114112:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580629:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877114368 00000100:00100000:1.0:1789427909.580632:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877114368 00000100:00100000:1.0:1789427909.580654:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877114624 00000100:00100000:1.0:1789427909.580657:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877114624 00000100:00080000:2.0:1789427909.580659:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427909.580665:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427909.580676:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789427909.580683:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877114368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427909.580686:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789427909.580693:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877114624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580714:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877114368:12345-0@lo:400:kworker.0 Request processed in 32us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427909.580721:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789427909.580722:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877114624:12345-0@lo:400:kworker.0 Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427909.580727:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789427909.580743:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789427909.580749:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93341e077100, transno 4294967312 00000100:00100000:2.0:1789427909.580750:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877114624:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580759:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877114368:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.580769:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877114240:0@lo:400:kworker.0 00000100:00100000:1.0:1789427909.581799:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877114752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427909.581846:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427909.584534:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877114752 00000100:00100000:3.0:1789427909.584558:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877114752 00000100:00100000:3.0:1789427909.585538:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789427909.585555:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877114752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427909.585652:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427909.585788:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877114752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 237us (3940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427909.585798:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789427909.585919:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877114752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789427909.837205:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789427910.686050:0:12313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:18:29 (1789427909) 00010000:00010000:2.0:1789427910.861376:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427911.645765:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427911.645900:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427911.645971:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427911.646006:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427911.646041:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427911.646111:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857182336 00000100:00100000:0.0:1789427911.646126:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857182336 00000100:00100000:0.0:1789427911.646243:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 298 00000100:00100000:0.0:1789427911.646256:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857182336:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427911.646351:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857182336:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 98us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427911.646360:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 298 00000100:00100000:0.0:1789427911.646560:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857182720 00000100:00100000:0.0:1789427911.646578:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857182720 00000100:00100000:0.0:1789427911.646623:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857182592 00000100:00100000:0.0:1789427911.646627:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857182592 00000100:00100000:0.0:1789427911.646646:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 77 00000100:00100000:0.0:1789427911.646652:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857182720:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427911.646685:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857182720:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 33us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427911.646692:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 77 00000100:00100000:0.0:1789427911.646704:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 78 00000100:00100000:0.0:1789427911.646710:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857182592:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427911.646733:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857182592:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 23us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427911.646739:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 78 00000100:00080000:3.0:1789427911.646932:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789427911.646938:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427911.647734:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857182464 00000100:00100000:1.0:1789427911.648688:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857182464 00000100:00100000:1.0:1789427911.648901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857182848 00000100:00100000:1.0:1789427911.648906:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857182848 00000100:00100000:3.0:1789427911.651737:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 160 00000100:00100000:3.0:1789427911.651763:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+13:2357:x1876350857182464:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427911.651925:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+13:2357:x1876350857182464:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 173us (6176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427911.651938:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 160 00000100:00100000:0.0:1789427911.653142:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 161 00000100:00100000:0.0:1789427911.653157:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857182848:12345-192.168.201.55@tcp:400:kworker.0 00000100:00080000:2.0:1789427911.653586:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427911.656428:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857182848:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 3259us (10370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427911.656448:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 161 00010000:00010000:3.0:1789427911.882663:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427912.383205:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427912.383359:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857183104 00000100:00100000:0.0:1789427912.383370:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857183104 00000100:00100000:0.0:1789427912.383434:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 136 00000100:00100000:0.0:1789427912.383445:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+13:11284:x1876350857183104:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427912.383464:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427912.383489:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88f4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.383594:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.383608:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.383621:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.383635:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.383641:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.383647:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.383878:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343c67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.383888:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343c67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.383895:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343c67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427912.383905:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789427912.384030:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384038:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384051:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384056:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427912.384060:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384067:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384078:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93342215bf00) 00010000:00010000:0.0:1789427912.384081:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427912.384086:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384092:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343c59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384104:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384109:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384114:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384119:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427912.384122:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384137:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384145:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9334083ca700) 00010000:00010000:0.0:1789427912.384163:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427912.384167:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384221:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343c60 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384626:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343c52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88f4 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384642:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343c67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88f4 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.384650:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:0.0:1789427912.384652:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427912.384654:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179800, rc 0) 00000100:00100000:0.0:1789427912.384738:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+15:11284:x1876350857183104:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 1293us (1574us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789427912.384747:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 136 00000100:00100000:3.0:1789427912.394112:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427912.394238:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427912.394260:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857183232 00000100:00100000:1.0:1789427912.394281:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857183232 00000100:00100000:1.0:1789427912.394351:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 137 00000100:00100000:1.0:1789427912.394364:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+15:11284:x1876350857183232:12345-192.168.201.55@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789427912.394498:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+15:11284:x1876350857183232:12345-192.168.201.55@tcp:59:lhsmtool_posix.0 Request processed in 137us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427912.394507:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 137 00000100:00100000:0.0:1789427912.394605:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857183360 00000100:00100000:0.0:1789427912.394610:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857183360 00000100:00100000:0.0:1789427912.394657:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:0.0:1789427912.394664:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+15:2357:x1876350857183360:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427912.394693:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427912.394719:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca343c67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88f4 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427912.394739:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:0.0:1789427912.394744:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427912.394766:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+14:2357:x1876350857183360:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 103us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427912.394772:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00000040:00080000:0.0:1789427912.457487:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427912.457498:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427912.457974:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789427912.457984:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789427912.910904:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427913.673461:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343fac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877114880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427913.673541:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427913.673620:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877114880 00000100:00100000:1.0:1789427913.673629:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877114880 00000100:00100000:1.0:1789427913.673682:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789427913.673691:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877114880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427913.673742:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427913.673991:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877114880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427913.674000:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789427913.674022:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427913.674070:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343fac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877114880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789427913.937620:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789427914.244585:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:2.0:1789427914.509503:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427914.509512:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427914.509994:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789427914.510002:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789427914.599629:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427914.599755:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857183488 00000100:00100000:3.0:1789427914.599767:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857183488 00000100:00080000:1.0:1789427914.600506:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427914.600632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 138 00000100:00100000:3.0:1789427914.600647:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+13:11327:x1876350857183488:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427914.600670:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427914.600694:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343c75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a88fb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.600780:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.600795:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.600808:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.600824:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.600832:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.600838:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601052:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601061:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601076:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601083:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427914.601087:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601095:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601108:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083cab00) 00010000:00010000:3.0:1789427914.601111:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427914.601116:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601123:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601134:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601140:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601146:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601151:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427914.601154:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601169:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601206:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff933410b41100) 00010000:00010000:3.0:1789427914.601208:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427914.601212:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601218:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343c83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601251:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343c75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88fb expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601260:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083cab00) 00010000:00010000:3.0:1789427914.601262:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427914.601266:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343c75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88fb expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.601274:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030400, rc 0) 00000100:00100000:3.0:1789427914.601340:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+13:11327:x1876350857183488:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 698us (1720us total) trans 0 rc 301/301 00000100:00100000:3.0:1789427914.601348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 138 00000100:00100000:3.0:1789427914.614079:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427914.616606:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857183744 00000100:00100000:1.0:1789427914.616619:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857183744 00000100:00100000:1.0:1789427914.616682:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 139 00000100:00100000:1.0:1789427914.616692:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+13:11327:x1876350857183744:12345-192.168.201.55@tcp:36:lfs.0 00010000:00010000:1.0:1789427914.616755:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427914.616791:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca343601 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a873b expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.616810:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9334083cab00) 00010000:00010000:1.0:1789427914.616835:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427914.617033:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.617047:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.617058:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.617071:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.617078:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.617085:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427914.617957:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789427914.617969:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.617978:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.617985:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.617997:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427914.618001:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.618009:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.618020:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427914.618024:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427914.618028:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.618033:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c8a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427914.618048:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b4913f60 reply state 0000000088620f47 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427914.618057:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427914.618152:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+14:11327:x1876350857183744:12345-192.168.201.55@tcp:36:lfs.0 Request processed in 1460us (4083us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789427914.618161:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 139 00010000:00010000:2.0:1789427914.627545:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.627567:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.627575:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.627580:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427914.627585:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.627593:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.627609:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff933408914500) 00010000:00010000:2.0:1789427914.627613:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427914.627619:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.627626:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343c91 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427914.698313:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877115008:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.698393:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427914.698440:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877115520:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.698466:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427914.698491:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789427914.698497:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877115136:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.698544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427914.698563:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877115648:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.698585:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427914.698617:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877115264:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.698640:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427914.698658:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427914.698664:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877115392:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.698684:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427914.698716:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877115008 00000100:00100000:1.0:1789427914.698725:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877115008 00000100:00100000:1.0:1789427914.703576:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789427914.703607:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877115008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.703705:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877115008:12345-0@lo:400:kworker.0 Request processed in 110us (5312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.703712:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789427914.703762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877115520 00000100:00100000:1.0:1789427914.703771:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877115520 00000100:00100000:2.0:1789427914.704085:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877115008:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.704202:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877115136 00000100:00100000:1.0:1789427914.704206:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877115136 00000100:00100000:1.0:1789427914.704220:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877115264 00000100:00100000:1.0:1789427914.704222:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877115264 00000100:00100000:1.0:1789427914.704238:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789427914.704243:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877115520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.704286:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877115520:12345-0@lo:400:kworker.0 Request processed in 41us (5818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.704292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789427914.704304:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789427914.704322:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877115136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.704351:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877115136:12345-0@lo:400:kworker.0 Request processed in 31us (5807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.704357:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789427914.704369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789427914.704375:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877115264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.704405:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877115264:12345-0@lo:400:kworker.0 Request processed in 30us (5764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.704411:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789427914.704433:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877115648 00000100:00100000:1.0:1789427914.704437:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877115648 00000100:00100000:1.0:1789427914.704466:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877115392 00000100:00100000:1.0:1789427914.704469:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877115392 00000100:00100000:1.0:1789427914.704489:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789427914.704496:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877115648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.704541:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877115648:12345-0@lo:400:kworker.0 Request processed in 45us (5954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.704548:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789427914.704559:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789427914.704564:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877115392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.704592:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877115392:12345-0@lo:400:kworker.0 Request processed in 28us (5907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.704598:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789427914.704630:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789427914.704642:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877115776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427914.704673:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427914.704715:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877115776 00000100:00100000:1.0:1789427914.704719:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877115776 00000100:00100000:1.0:1789427914.704742:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789427914.704749:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877115776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427914.704785:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427914.704830:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877115776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.704835:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789427914.704869:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877115776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427914.704890:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877115392:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.704899:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877115264:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.708371:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877115136:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.708389:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877115648:0@lo:400:kworker.0 00000100:00100000:1.0:1789427914.708399:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877115520:0@lo:400:kworker.0 00000100:00080000:2.0:1789427914.709930:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427914.709940:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427914.775248:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427914.775465:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857183872 00000100:00100000:1.0:1789427914.775476:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857183872 00000100:00100000:1.0:1789427914.775565:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 140 00000100:00100000:1.0:1789427914.775576:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+13:11335:x1876350857183872:12345-192.168.201.55@tcp:101:lctl.0 00010000:00010000:1.0:1789427914.775603:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427914.775626:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8902 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.775694:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343c9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.775727:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.775739:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427914.775777:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789427914.775780:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427914.775803:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.775827:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343c98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8902 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.775845:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343c9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8902 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.775854:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427914.775857:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427914.775860:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700c00, rc 0) 00000100:00100000:1.0:1789427914.775926:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+14:11335:x1876350857183872:12345-192.168.201.55@tcp:101:lctl.0 Request processed in 351us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.775933:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 140 00000100:00100000:1.0:1789427914.863834:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427914.864676:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857184000 00000100:00100000:2.0:1789427914.864703:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857184000 00000100:00100000:2.0:1789427914.864778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 141 00000100:00100000:2.0:1789427914.864789:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+14:11341:x1876350857184000:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:2.0:1789427914.864821:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427914.864844:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8909 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.864911:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.864924:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.864935:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.864950:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.864957:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.864963:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865097:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca343cbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865105:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca343cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865111:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca343cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427914.865138:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789427914.865142:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427914.865159:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca343cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865170:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865231:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865238:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865244:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427914.865248:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865255:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865267:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:2.0:1789427914.865275:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427914.865280:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865286:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343cad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865300:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865305:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865311:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865316:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401491c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427914.865319:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865324:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865330:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93342215b500) 00010000:00010000:2.0:1789427914.865332:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427914.865335:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865340:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343cb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865369:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8909 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865391:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca343cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8909 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427914.865398:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:2.0:1789427914.865400:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789427914.865402:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401490c00, rc 0) 00000100:00100000:2.0:1789427914.865606:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+15:11341:x1876350857184000:12345-192.168.201.55@tcp:101:bash.0 Request processed in 818us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427914.865612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 141 00000100:00100000:3.0:1789427914.874528:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427914.874865:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857184256 00000100:00100000:1.0:1789427914.874876:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857184256 00000100:00100000:1.0:1789427914.874938:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 142 00000100:00100000:1.0:1789427914.874947:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+15:11341:x1876350857184256:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:1.0:1789427914.874981:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427914.875001:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343cc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8910 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.875135:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.875150:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.875162:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.875209:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.875217:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.875224:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427914.875794:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789427914.875953:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.875964:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.875971:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.876015:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.876022:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.876030:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.876037:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427914.876041:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.876049:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.876062:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:1.0:1789427914.876065:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427914.876070:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.876077:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343cc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427914.876089:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004b574604 reply state 000000002ebc4b32 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427914.876098:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789427914.876883:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343cc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8910 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.876921:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8910 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.876930:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914800) 00010000:00010000:1.0:1789427914.876933:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427914.876936:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701000, rc 0) 00000100:00100000:1.0:1789427914.877032:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+18:11341:x1876350857184256:12345-192.168.201.55@tcp:101:bash.0 Request processed in 2084us (2524us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789427914.877041:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 142 00010000:00010000:1.0:1789427914.879894:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.879912:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.879921:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.879928:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427914.879932:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.879940:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.879955:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933408914d00) 00010000:00010000:1.0:1789427914.879959:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427914.879963:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.879985:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427914.887666:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427914.888652:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857184384 00000100:00100000:1.0:1789427914.888666:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857184384 00000100:00100000:1.0:1789427914.888760:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00100000:1.0:1789427914.888771:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857184384:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:1.0:1789427914.888790:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427914.888810:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8917 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789427914.888847:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789427914.888866:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1789427914.888871:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427914.888880:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8917 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.888900:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8917 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.888913:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700e00, rc 0) 00000100:00100000:1.0:1789427914.888972:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857184384:12345-192.168.201.55@tcp:101:bash.0 Request processed in 204us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.888979:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00080000:2.0:1789427914.889271:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789427914.892499:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427914.892669:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857184512 00000100:00100000:1.0:1789427914.892679:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857184512 00000100:00100000:1.0:1789427914.892749:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:1.0:1789427914.892759:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:11341:x1876350857184512:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:1.0:1789427914.892776:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427914.892794:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a891e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.892825:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8917 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.892835:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427914.892839:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427914.892844:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.892876:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8917 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.892889:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8917 expref: 7 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427914.892903:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876350877115904:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427914.893015:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427914.900717:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427914.901295:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857184640 00000100:00100000:3.0:1789427914.901305:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857184640 00010000:00010000:3.0:1789427914.901347:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8917 expref: 8 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427914.901393:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 61 00000100:00100000:3.0:1789427914.901402:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857184640:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427914.901418:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427914.901442:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8917 expref: 8 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.901457:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8917 expref: 8 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.901483:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427914.901488:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427914.901497:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.901520:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427914.901560:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427914.901576:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1876350877116032:192.168.201.55@tcp:105: 00000100:00100000:3.0:1789427914.901681:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc300 going to sleep for 11 seconds 00010000:00010000:1.0:1789427914.902171:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343ce5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8917 expref: 8 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427914.902228:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876350877115904:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427914.902261:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427914.902272:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701400, rc 0) 00000100:00100000:1.0:1789427914.902307:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:11341:x1876350857184512:12345-192.168.201.55@tcp:101:bash.0 Request processed in 9549us (9816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427914.902316:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:0.0:1789427914.913360:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427914.913654:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857184896 00000100:00100000:2.0:1789427914.913665:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857184896 00000100:00100000:2.0:1789427914.913729:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:2.0:1789427914.913739:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+17:11341:x1876350857184896:12345-192.168.201.55@tcp:35:bash.0 00000100:00100000:2.0:1789427914.914093:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+18:11341:x1876350857184896:12345-192.168.201.55@tcp:35:bash.0 Request processed in 353us (741us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789427914.914101:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:3.0:1789427914.922932:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1876350877116032:192.168.201.55@tcp:105: 00010000:00010000:3.0:1789427914.922964:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427914.923151:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857184640:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 21747us (22440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427914.923163:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 61 00010000:00010000:2.0:1789427914.954188:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427915.034584:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427915.034763:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857185152 00000100:00100000:1.0:1789427915.034775:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857185152 00000100:00100000:1.0:1789427915.034954:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 143 00000100:00100000:1.0:1789427915.034966:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+18:11351:x1876350857185152:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427915.034989:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427915.035010:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8925 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427915.035098:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789427915.035297:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8925 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.035311:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427915.035314:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427915.035319:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8925 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.035333:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700e00, rc 0) 00000100:00100000:1.0:1789427915.035677:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+19:11351:x1876350857185152:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 712us (1101us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1789427915.035707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 143 00000100:00100000:0.0:1789427915.043094:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.043244:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857185408 00000100:00100000:2.0:1789427915.043256:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857185408 00000100:00100000:2.0:1789427915.043317:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00100000:2.0:1789427915.043328:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+19:11351:x1876350857185408:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427915.043727:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+20:11351:x1876350857185408:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 400us (640us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789427915.043736:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00100000:0.0:1789427915.158848:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.158951:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857185536 00000100:00100000:2.0:1789427915.158961:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857185536 00000100:00100000:2.0:1789427915.159027:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 144 00000100:00100000:2.0:1789427915.159037:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+20:11357:x1876350857185536:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427915.159062:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427915.159081:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a892c expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.159147:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca343d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.159161:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca343d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.159212:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca343d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427915.159250:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789427915.159254:0:8694:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427915.159273:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca343d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.159300:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a892c expref: 22 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.159319:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca343d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a892c expref: 21 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.159341:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:2.0:1789427915.159344:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427915.159348:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401491600, rc 0) 00000100:00100000:2.0:1789427915.159398:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+21:11357:x1876350857185536:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 362us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427915.159405:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 144 00000100:00100000:3.0:1789427915.163319:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.163466:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857185792 00000100:00100000:2.0:1789427915.163476:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857185792 00000100:00100000:2.0:1789427915.163546:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 145 00000100:00100000:2.0:1789427915.163557:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+21:11357:x1876350857185792:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427915.163578:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427915.163598:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8933 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.163722:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.163737:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.163748:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427915.163857:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789427915.163995:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8933 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.164030:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8933 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.164037:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914800) 00010000:00010000:2.0:1789427915.164040:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427915.164044:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02be00, rc 0) 00000100:00100000:2.0:1789427915.164147:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+23:11357:x1876350857185792:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 591us (838us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789427915.164155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 145 00000100:00100000:0.0:1789427915.178810:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427915.179000:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857186048 00000100:00100000:3.0:1789427915.179021:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857186048 00000100:00100000:3.0:1789427915.179083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 146 00000100:00100000:3.0:1789427915.179093:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+23:11357:x1876350857186048:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427915.179119:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427915.179141:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343d24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a893a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.179289:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343d2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.179304:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.179317:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427915.179330:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789427915.179474:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343d24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a893a expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.179494:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a893a expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.179514:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914800) 00010000:00010000:3.0:1789427915.179532:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789427915.179536:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789427915.179593:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+25:11357:x1876350857186048:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 501us (793us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789427915.179600:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 146 00000100:00100000:0.0:1789427915.181929:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427915.182040:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857186176 00000100:00100000:3.0:1789427915.182049:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857186176 00000100:00100000:3.0:1789427915.182111:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:3.0:1789427915.182120:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+25:2356:x1876350857186176:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427915.182133:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427915.182157:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8933 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.182195:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914800) 00010000:00010000:3.0:1789427915.182201:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427915.182252:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+24:2356:x1876350857186176:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 133us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427915.182259:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:0.0:1789427915.192836:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427915.192920:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857186304 00000100:00100000:1.0:1789427915.192930:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857186304 00000100:00100000:1.0:1789427915.192989:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:1.0:1789427915.193000:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2354:x1876350857186304:12345-192.168.201.55@tcp:1:lfs.0 00010000:00010000:1.0:1789427915.193059:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.193081:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.193090:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789427915.193095:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427915.193100:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.193136:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.193151:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 6 pid: 6685 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427915.193164:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876350877116160:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427915.193287:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789427915.200408:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427915.200512:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876350877116160:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427915.200552:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427915.200609:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857186432 00000100:00100000:3.0:1789427915.200618:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857186432 00002000:00100000:3.0:1789427915.200663:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93343a8c1180 x1876350857186432/t0(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:161/0 lens 504/0 e 0 to 0 dl 1789427926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789427915.200673:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93343a8c1180 with x1876350857186432 ext(0->12) 00010000:00010000:3.0:1789427915.200691:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 7 pid: 6685 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.200704:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 7 pid: 6685 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427915.200718:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93343a8c1180 00000100:00100000:3.0:1789427915.200752:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:3.0:1789427915.200762:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857186432:12345-192.168.201.55@tcp:4:lfs.0 00000100:00100000:3.0:1789427915.201276:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857186432:12345-192.168.201.55@tcp:4:lfs.0 Request processed in 513us (874us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789427915.201283:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 2 00002000:00100000:3.0:1789427915.201291:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93343a8c1180 x1876350857186432/t4294967305(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:161/0 lens 504/448 e 0 to 0 dl 1789427926 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789427915.201299:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93343a8c1180 with x1876350857186432 ext(0->12) 00010000:00010000:3.0:1789427915.201305:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 9 pid: 6685 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.201317:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 9 pid: 6685 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427915.201324:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93343a8c1180 00000100:00100000:0.0:1789427915.218880:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.218980:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857186560 00000100:00100000:2.0:1789427915.218990:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857186560 00010000:00010000:2.0:1789427915.219044:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 9 pid: 6685 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427915.219090:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 62 00000100:00100000:2.0:1789427915.219101:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857186560:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427915.219117:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789427915.219138:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789427915.219141:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789427915 00002000:00010000:2.0:1789427915.219143:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789427915 00002000:00010000:2.0:1789427915.219145:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789427915 00010000:00010000:2.0:1789427915.219151:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 9 pid: 6685 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.219166:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 9 pid: 6685 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.219234:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca343cec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a891e expref: 9 pid: 6685 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.219252:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427915.219256:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427915.219262:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.219272:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.219308:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427915.219453:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.219463:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.219488:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.219497:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.219518:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.219525:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789427915.219530:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.219539:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.219551:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.219568:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f665b416/0x2bea1a57ca343d39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427915.219645:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857186560:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 544us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427915.219653:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 62 00000100:00100000:1.0:1789427915.221132:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2354:x1876350857186304:12345-192.168.201.55@tcp:1:lfs.0 Request processed in 28124us (28296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427915.221144:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:0.0:1789427915.227239:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427915.227335:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857186816 00000100:00100000:1.0:1789427915.227348:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857186816 00000100:00100000:1.0:1789427915.227400:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 38 00000100:00100000:1.0:1789427915.227410:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+24:11357:x1876350857186816:12345-192.168.201.55@tcp:35:lfs.0 00000004:00010000:1.0:1789427915.227475:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a893a expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427915.227745:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1789427915.227785:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789427915.228493:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1789427915.228570:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.228588:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8910 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.228597:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.228634:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8910 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.228663:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8910 expref: 28 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427915.228678:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1876350877116288:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427915.228763:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789427915.235772:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1876350877116288:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427915.235804:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427915.236323:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427915.237646:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857186944 00000100:00100000:3.0:1789427915.237659:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857186944 00010000:00010000:3.0:1789427915.237719:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8910 expref: 29 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427915.237816:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 63 00000100:00100000:3.0:1789427915.237832:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+29:2357:x1876350857186944:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427915.237865:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427915.237872:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8910 expref: 29 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.237893:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8910 expref: 29 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.237917:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8910 expref: 29 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.237935:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914800) 00010000:00010000:3.0:1789427915.237940:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.237950:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.237959:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.237982:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427915.238059:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+28:2357:x1876350857186944:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 229us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427915.238074:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 63 00010000:00010000:1.0:1789427915.238604:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.238615:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427915.238754:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789427915.238945:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1789427915.239077:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1876350877116416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789427915.239133:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427915.239201:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789427915.239594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877116416 00000100:00100000:0.0:1789427915.239603:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877116416 00000100:00100000:0.0:1789427915.239658:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789427915.239667:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1876350877116416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789427915.239758:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1876350877116416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427915.239766:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789427915.241379:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1876350877116416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789427915.241906:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789427915.241986:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1876350877116544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789427915.242053:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427915.242446:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789427915.245168:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877116544 00000100:00100000:0.0:1789427915.245295:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877116544 00000100:00100000:0.0:1789427915.245520:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789427915.245532:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1876350877116544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789427915.245809:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1876350877116544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 279us (3754us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789427915.245817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789427915.245902:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1876350877116544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789427915.245975:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789427915.246034:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.246046:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.246054:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.246061:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427915.246081:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.246089:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.246104:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914800) 00010000:00010000:2.0:1789427915.246107:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789427915.246112:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.246119:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343d40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789427915.246349:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789427915.246462:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789427915.246473:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370181297172ns, next at 371181295037ns, rc = 0 00000001:00080000:2.0:1789427915.246479:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789427915.246522:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914800) 00010000:00010000:2.0:1789427915.246526:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789427915.246532:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343d2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a893a expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427915.246635:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419ad8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+31:11357:x1876350857186816:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 19226us (19404us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789427915.246642:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 38 00000020:00080000:2.0:1789427915.246646:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789427915.248872:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427915.248945:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857187072 00000100:00100000:1.0:1789427915.248965:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857187072 00000100:00100000:1.0:1789427915.249061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 147 00000100:00100000:1.0:1789427915.249072:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+31:11357:x1876350857187072:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427915.249096:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427915.249118:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8941 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.249215:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8941 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.249231:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8941 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.249250:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427915.249253:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789427915.249257:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700e00, rc 0) 00000100:00100000:1.0:1789427915.249305:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+32:11357:x1876350857187072:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 234us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427915.249311:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 147 00000100:00100000:0.0:1789427915.253408:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.253565:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857187328 00000100:00100000:2.0:1789427915.253575:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857187328 00000100:00100000:2.0:1789427915.253629:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 39 00000100:00100000:2.0:1789427915.253638:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+32:11357:x1876350857187328:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427915.253861:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+33:11357:x1876350857187328:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 224us (463us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789427915.253869:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 39 00000100:00100000:0.0:1789427915.361556:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427915.362041:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857187584 00000100:00100000:3.0:1789427915.362053:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857187584 00000100:00100000:3.0:1789427915.362324:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 148 00000100:00100000:3.0:1789427915.362335:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+33:11367:x1876350857187584:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427915.362376:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427915.362398:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343d4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8948 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427915.362488:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789427915.365009:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343d4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8948 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.365031:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:3.0:1789427915.365034:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427915.365039:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343d4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8948 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.365054:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030400, rc 0) 00000100:00100000:3.0:1789427915.365432:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+34:11367:x1876350857187584:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 3097us (3884us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1789427915.365442:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 148 00000100:00100000:0.0:1789427915.371115:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.372016:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857187712 00000100:00100000:2.0:1789427915.372029:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857187712 00000100:00100000:2.0:1789427915.372094:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 149 00000100:00100000:2.0:1789427915.372104:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+34:11367:x1876350857187712:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:2.0:1789427915.372428:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.372448:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.372461:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.372478:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.372484:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.372489:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.372594:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.372602:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.372628:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427915.372668:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373288:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373295:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373303:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373308:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427915.373312:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373320:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373332:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:2.0:1789427915.373335:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427915.373338:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373345:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373358:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373372:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373378:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373383:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427915.373386:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373392:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373399:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93342215b500) 00010000:00010000:2.0:1789427915.373402:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427915.373404:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373410:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373423:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373429:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373435:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373440:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401490a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427915.373446:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373453:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373460:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427915.373462:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427915.373464:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.373469:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427915.373561:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+34:11367:x1876350857187712:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 1456us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427915.373569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 149 00000100:00100000:1.0:1789427915.377913:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.378056:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857187968 00000100:00100000:2.0:1789427915.378068:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857187968 00000100:00100000:2.0:1789427915.378132:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 40 00000100:00100000:2.0:1789427915.378142:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+34:11367:x1876350857187968:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427915.378399:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+35:11367:x1876350857187968:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 257us (495us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789427915.378407:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 40 00000100:00100000:0.0:1789427915.425737:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.426392:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857188224 00000100:00100000:2.0:1789427915.426403:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857188224 00000100:00100000:2.0:1789427915.426469:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 150 00000100:00100000:2.0:1789427915.426480:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+35:11370:x1876350857188224:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427915.426525:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427915.426564:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a894f expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.426660:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.426676:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.426688:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.426706:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.426713:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.426720:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.426837:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.426847:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.426854:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427915.426864:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789427915.427751:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427780:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427788:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427794:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401491c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427915.427798:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427805:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427818:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:2.0:1789427915.427821:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427915.427825:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427831:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca343d78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427845:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427851:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427857:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427862:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427915.427871:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.427878:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.428452:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93342215b500) 00010000:00010000:2.0:1789427915.428459:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427915.428464:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.428471:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343d7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.428619:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca343d71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a894f expref: 38 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.428649:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a894f expref: 37 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.428657:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427915.428660:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427915.428663:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a400, rc 0) 00000100:00100000:2.0:1789427915.428871:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+37:11370:x1876350857188224:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 2391us (3142us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789427915.428881:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 150 00000100:00100000:0.0:1789427915.434015:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427915.434229:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857188352 00000100:00100000:1.0:1789427915.434242:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857188352 00000100:00100000:1.0:1789427915.434300:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 151 00000100:00100000:1.0:1789427915.434309:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+37:11370:x1876350857188352:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:1.0:1789427915.434382:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.434399:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.434426:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.434454:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.434462:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.434468:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.434475:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427915.434479:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.434486:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.434515:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427915.434518:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427915.434524:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427915.434530:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427915.434599:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+37:11370:x1876350857188352:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 290us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427915.434606:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 151 00000100:00100000:1.0:1789427915.439490:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.439592:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857188608 00000100:00100000:2.0:1789427915.439602:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857188608 00000100:00100000:2.0:1789427915.439671:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 41 00000100:00100000:2.0:1789427915.439681:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+37:11370:x1876350857188608:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427915.439927:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+38:11370:x1876350857188608:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 246us (444us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789427915.439936:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 41 00000100:00100000:0.0:1789427915.947001:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427915.947237:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857188864 00000100:00100000:3.0:1789427915.947248:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857188864 00000100:00100000:3.0:1789427915.947318:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 152 00000100:00100000:3.0:1789427915.947329:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+38:11401:x1876350857188864:12345-192.168.201.55@tcp:101:cat.0 00010000:00010000:3.0:1789427915.947371:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427915.947394:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343d9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8956 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.947507:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343da2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.947538:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.947550:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427915.947563:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789427915.947693:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343d9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8956 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.947712:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8956 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427915.947720:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:3.0:1789427915.947722:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427915.947726:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031800, rc 0) 00000100:00100000:3.0:1789427915.947793:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+40:11401:x1876350857188864:12345-192.168.201.55@tcp:101:cat.0 Request processed in 466us (803us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789427915.947800:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 152 00000100:00100000:0.0:1789427915.956018:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.956524:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857189120 00000100:00100000:2.0:1789427915.956536:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857189120 00000100:00100000:2.0:1789427915.956600:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:2.0:1789427915.956612:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+40:11401:x1876350857189120:12345-192.168.201.55@tcp:35:cat.0 00000100:00100000:2.0:1789427915.956884:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+41:11401:x1876350857189120:12345-192.168.201.55@tcp:35:cat.0 Request processed in 266us (866us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789427915.956892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:1.0:1789427915.968365:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427915.968463:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857189248 00000100:00100000:2.0:1789427915.968474:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857189248 00000100:00100000:2.0:1789427915.968555:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:2.0:1789427915.968565:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+41:2357:x1876350857189248:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427915.968579:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427915.968604:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8956 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427915.968624:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427915.968629:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427915.968705:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+40:2357:x1876350857189248:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 141us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427915.968712:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00010000:00010000:3.0:1789427915.977575:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427916.043294:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427916.043372:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857189504 00000100:00100000:1.0:1789427916.043383:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857189504 00000100:00100000:1.0:1789427916.043448:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 153 00000100:00100000:1.0:1789427916.043456:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+40:11407:x1876350857189504:12345-192.168.201.55@tcp:101:dd.0 00010000:00010000:1.0:1789427916.043478:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427916.043480:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789427916.043515:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca343d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a892c expref: 40 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.043543:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:1.0:1789427916.043548:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427916.043562:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343db0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a895d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.043676:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.043691:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a894f expref: 40 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.043699:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.043733:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a894f expref: 40 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.043746:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a894f expref: 40 pid: 8694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427916.043780:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877116672:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427916.043872:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a900 going to sleep for 11 seconds 00000100:00080000:2.0:1789427916.045811:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427916.048218:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877116672:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427916.048252:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427916.051111:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427916.052306:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857189632 00000100:00100000:2.0:1789427916.052335:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857189632 00010000:00010000:2.0:1789427916.052383:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a894f expref: 41 pid: 8694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427916.052432:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 64 00000100:00100000:2.0:1789427916.052443:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+41:2356:x1876350857189632:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427916.052459:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427916.052466:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a894f expref: 41 pid: 8694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.052481:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a894f expref: 41 pid: 8694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.052521:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343d86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a894f expref: 41 pid: 8694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.052539:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427916.052545:0:11166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.052554:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.052562:0:11166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.052652:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427916.052726:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+40:2356:x1876350857189632:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 284us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427916.052743:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 64 00010000:00010000:1.0:1789427916.054587:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.054603:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427916.054627:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789427916.054806:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343db0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a895d expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.055002:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a895d expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.055012:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427916.055015:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789427916.055018:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701a00, rc 0) 00000100:00100000:1.0:1789427916.055314:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+40:11407:x1876350857189504:12345-192.168.201.55@tcp:101:dd.0 Request processed in 11856us (12024us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789427916.055323:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 153 00000100:00100000:0.0:1789427916.062020:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427916.062437:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857189888 00000100:00100000:3.0:1789427916.062448:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857189888 00000100:00100000:3.0:1789427916.062526:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 154 00000100:00100000:3.0:1789427916.062537:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+40:11407:x1876350857189888:12345-192.168.201.55@tcp:36:dd.0 00010000:00010000:3.0:1789427916.062809:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.062836:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.062861:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427916.062916:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1789427916.062943:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c0c1d05a reply state 000000007ee972b8 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427916.062953:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427916.063060:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+43:11407:x1876350857189888:12345-192.168.201.55@tcp:36:dd.0 Request processed in 523us (1049us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789427916.063804:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 154 00000020:00080000:3.0:1789427916.063810:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789427916.074203:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.074226:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.074234:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.074240:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427916.074245:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.074253:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.074272:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427916.074276:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427916.074281:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.074288:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427916.500403:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427916.500516:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857190016 00000100:00100000:3.0:1789427916.500528:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857190016 00000100:00100000:3.0:1789427916.500587:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 155 00000100:00100000:3.0:1789427916.500597:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+42:11421:x1876350857190016:12345-192.168.201.55@tcp:101:stat.0 00010000:00010000:3.0:1789427916.500623:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427916.500643:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343dcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8964 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500709:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500724:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500736:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500763:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500771:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500777:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500873:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500885:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a895d expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500893:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500926:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a895d expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.500940:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a895d expref: 43 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427916.500954:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877116800:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427916.501230:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334119dfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427916.504366:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427916.504472:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857190272 00000100:00100000:0.0:1789427916.504492:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857190272 00000100:00100000:2.0:1789427916.504660:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877116800:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789427916.504685:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427916.504737:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 43 00000100:00100000:0.0:1789427916.504748:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+44:5592:x1876350857190272:12345-192.168.201.55@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789427916.505243:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+45:5592:x1876350857190272:12345-192.168.201.55@tcp:35:ldlm_bl.0 Request processed in 495us (885us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789427916.505252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 43 00000100:00100000:1.0:1789427916.508464:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427916.508588:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857190400 00000100:00100000:2.0:1789427916.508603:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857190400 00010000:00010000:2.0:1789427916.508643:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a895d expref: 45 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427916.508743:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 65 00000100:00100000:2.0:1789427916.508754:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+45:2357:x1876350857190400:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427916.508769:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427916.508775:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a895d expref: 45 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.508788:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a895d expref: 45 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.508808:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343db7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a895d expref: 45 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.508835:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427916.508841:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.508851:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.508859:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427916.508891:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427916.508942:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+44:2357:x1876350857190400:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 189us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427916.508959:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 65 00010000:00010000:1.0:1789427916.509202:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509211:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427916.509256:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789427916.509261:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427916.509282:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509295:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509307:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509314:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509322:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509328:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427916.509332:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509340:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509350:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:1.0:1789427916.509353:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427916.509356:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509369:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509383:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509389:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509394:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509399:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427916.509402:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509408:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509416:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933410b41100) 00010000:00010000:1.0:1789427916.509419:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427916.509422:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509428:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343dda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509462:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8964 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509475:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8964 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.509505:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427916.509507:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427916.509510:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:1.0:1789427916.509538:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+43:11421:x1876350857190016:12345-192.168.201.55@tcp:101:stat.0 Request processed in 8943us (9143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427916.509545:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 155 00000100:00100000:2.0:1789427916.586710:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427916.586815:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857190656 00000100:00100000:1.0:1789427916.586825:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857190656 00000100:00100000:1.0:1789427916.586883:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 156 00000100:00100000:1.0:1789427916.586893:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+43:11427:x1876350857190656:12345-192.168.201.55@tcp:36:truncate.0 00010000:00010000:1.0:1789427916.586950:0:8694:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427916.586992:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343de1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8964 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.587012:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427916.587017:0:8694:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427916.587284:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.587298:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.587308:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427916.587353:0:8694:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1789427916.587376:0:8694:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ae72a7ed reply state 00000000f9105022 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427916.587399:0:8694:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427916.587508:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+45:11427:x1876350857190656:12345-192.168.201.55@tcp:36:truncate.0 Request processed in 615us (808us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789427916.587516:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 156 00000020:00080000:1.0:1789427916.587520:0:8694:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789427916.589921:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.589955:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.589973:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.589985:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427916.589989:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.589997:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.590013:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:3.0:1789427916.590016:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427916.590021:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427916.590027:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca343de8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427916.765650:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427916.765698:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427916.765732:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427916.765752:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427916.765773:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427916.765908:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857190912 00000100:00100000:0.0:1789427916.765919:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857190912 00000100:00100000:0.0:1789427916.765987:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 300 00000100:00100000:0.0:1789427916.765997:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857190912:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427916.766058:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857190912:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 61us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427916.766064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 300 00000100:00100000:3.0:1789427916.766492:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857191168 00000100:00100000:3.0:1789427916.766498:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857191168 00000100:00100000:3.0:1789427916.766542:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857191040 00000100:00100000:3.0:1789427916.766545:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857191040 00000100:00100000:3.0:1789427916.766567:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 81 00000100:00100000:3.0:1789427916.766574:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857191168:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427916.766608:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857191168:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 35us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427916.766615:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 81 00000100:00100000:3.0:1789427916.766646:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 82 00000100:00100000:3.0:1789427916.766652:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857191040:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427916.766678:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2357:x1876350857191040:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 27us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427916.766684:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 82 00000100:00100000:1.0:1789427916.766879:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857190784 00000100:00100000:1.0:1789427916.766883:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857190784 00000100:00100000:1.0:1789427916.766917:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857191296 00000100:00100000:1.0:1789427916.766920:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857191296 00000100:00100000:1.0:1789427916.766946:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 165 00000100:00100000:1.0:1789427916.766953:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857191296:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427916.766994:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a8c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857191296:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 41us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427916.767000:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 165 00000100:00100000:1.0:1789427916.767013:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 157 00000100:00100000:1.0:1789427916.767024:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+44:11441:x1876350857190784:12345-192.168.201.55@tcp:101:stat.0 00010000:00010000:1.0:1789427916.767037:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427916.767055:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343def lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a896b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767115:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767129:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767141:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767161:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767168:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767197:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767285:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767294:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767301:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427916.767335:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789427916.767339:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427916.767357:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767368:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767376:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767382:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767398:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767404:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427916.767408:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767416:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767429:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:1.0:1789427916.767432:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427916.767437:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767443:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767463:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767470:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767488:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767493:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427916.767496:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767511:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767519:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933408914600) 00010000:00010000:1.0:1789427916.767521:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427916.767524:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767530:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767563:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343def lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a896b expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767576:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a896b expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.767584:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427916.767586:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427916.767589:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701c00, rc 0) 00000100:00100000:1.0:1789427916.767615:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+45:11441:x1876350857190784:12345-192.168.201.55@tcp:101:stat.0 Request processed in 594us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427916.767622:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 157 00000100:00080000:2.0:1789427916.767894:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427916.767899:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427916.767902:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427916.915694:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427916.915807:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857191552 00000100:00100000:1.0:1789427916.915817:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857191552 00000100:00100000:1.0:1789427916.915884:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 158 00000100:00100000:1.0:1789427916.915895:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+45:11451:x1876350857191552:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427916.915933:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427916.915956:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343e0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8972 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427916.916054:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789427916.916210:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343e0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8972 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.916224:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427916.916227:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427916.916232:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343e0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8972 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427916.916246:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700a00, rc 0) 00000100:00100000:1.0:1789427916.916315:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+46:11451:x1876350857191552:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 421us (631us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789427916.916322:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 158 00000100:00100000:2.0:1789427916.924862:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427916.925589:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857191808 00000100:00100000:1.0:1789427916.925600:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857191808 00000100:00100000:1.0:1789427916.925676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 44 00000100:00100000:1.0:1789427916.925686:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419adb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+46:11451:x1876350857191808:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:1.0:1789427916.925946:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419adb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+47:11451:x1876350857191808:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 260us (1093us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789427916.925960:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 44 00010000:00010000:0.0:1789427917.001874:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427917.055281:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.055629:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857192064 00000100:00100000:1.0:1789427917.055641:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857192064 00000100:00100000:1.0:1789427917.055793:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 159 00000100:00100000:1.0:1789427917.055827:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+47:11457:x1876350857192064:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:1.0:1789427917.055853:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427917.055874:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343e19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8979 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.055983:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.055999:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a896b expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.056007:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.056041:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a896b expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.056053:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a896b expref: 48 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427917.056065:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877116928:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427917.056152:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789427917.062482:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877116928:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427917.062515:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427917.063385:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.063480:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857192192 00000100:00100000:1.0:1789427917.063488:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857192192 00010000:00010000:1.0:1789427917.063535:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a896b expref: 49 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427917.063574:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 66 00000100:00100000:1.0:1789427917.063583:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+49:2357:x1876350857192192:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427917.063597:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427917.063604:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a896b expref: 49 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.063617:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a896b expref: 49 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.063638:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a896b expref: 49 pid: 5836 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.063655:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427917.063659:0:11166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.063669:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.063677:0:11166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.063709:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427917.063762:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+48:2357:x1876350857192192:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 180us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427917.063770:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 66 00010000:00010000:2.0:1789427917.064421:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.064431:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427917.064449:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789427917.064906:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343e19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8979 expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.064927:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8979 expref: 48 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.064936:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427917.064948:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427917.064952:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701400, rc 0) 00000100:00100000:2.0:1789427917.065014:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+48:11457:x1876350857192064:12345-192.168.201.55@tcp:101:bash.0 Request processed in 9199us (9742us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789427917.065022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 159 00000100:00100000:2.0:1789427917.079644:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.079737:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857192448 00000100:00100000:1.0:1789427917.079747:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857192448 00000100:00100000:1.0:1789427917.079803:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 160 00000100:00100000:1.0:1789427917.079814:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+48:11457:x1876350857192448:12345-192.168.201.55@tcp:36:bash.0 00010000:00010000:1.0:1789427917.080110:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.080127:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.080140:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427917.080223:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1789427917.080245:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ebf68a9f reply state 00000000f579d9f3 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427917.080254:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427917.080337:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+51:11457:x1876350857192448:12345-192.168.201.55@tcp:36:bash.0 Request processed in 524us (702us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789427917.080344:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 160 00000020:00080000:1.0:1789427917.080348:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789427917.087561:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.087580:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.087588:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.087593:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427917.087598:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.087606:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.087623:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427917.087626:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427917.087630:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.087636:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427917.097168:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427917.097379:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857192576 00000100:00100000:3.0:1789427917.097390:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857192576 00000100:00100000:3.0:1789427917.097507:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 161 00000100:00100000:3.0:1789427917.097518:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+50:11457:x1876350857192576:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:3.0:1789427917.097542:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427917.097563:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8980 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.097640:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.097655:0:8694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8979 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.097664:0:8694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.097695:0:8694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8979 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.097710:0:8694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8979 expref: 51 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427917.097742:0:8694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b5fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877117056:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427917.097830:0:8694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334119dff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789427917.102675:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427917.102796:0:8694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b5fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877117056:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427917.102873:0:8694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427917.103000:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857192704 00000100:00100000:1.0:1789427917.103008:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857192704 00010000:00010000:1.0:1789427917.103044:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8979 expref: 52 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427917.103087:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 67 00000100:00100000:1.0:1789427917.103098:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+52:2357:x1876350857192704:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427917.103116:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427917.103139:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8979 expref: 52 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.103151:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8979 expref: 52 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.103203:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8979 expref: 52 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.103219:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427917.103223:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.103232:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.103240:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.105056:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427917.105139:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+51:2357:x1876350857192704:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 2037us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427917.105151:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 67 00010000:00010000:0.0:1789427917.109667:0:8694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.109685:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427917.109740:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789427917.109745:0:8694:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427917.109766:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.109810:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8980 expref: 51 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.109859:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8980 expref: 50 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.109869:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:0.0:1789427917.109872:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427917.109876:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030600, rc 0) 00000100:00100000:0.0:1789427917.109996:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+50:11457:x1876350857192576:12345-192.168.201.55@tcp:101:bash.0 Request processed in 12478us (12835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427917.110006:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 161 00000100:00100000:0.0:1789427917.130777:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.130911:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857192960 00000100:00100000:1.0:1789427917.130924:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857192960 00000100:00100000:1.0:1789427917.131027:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 45 00000100:00100000:1.0:1789427917.131037:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+50:11457:x1876350857192960:12345-192.168.201.55@tcp:35:bash.0 00000100:00100000:1.0:1789427917.131304:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+51:11457:x1876350857192960:12345-192.168.201.55@tcp:35:bash.0 Request processed in 268us (537us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789427917.131327:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 45 00000100:00100000:1.0:1789427917.231431:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427917.231549:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857193216 00000100:00100000:2.0:1789427917.231573:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857193216 00000100:00100000:2.0:1789427917.231636:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 162 00000100:00100000:2.0:1789427917.231655:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+51:11467:x1876350857193216:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427917.231681:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427917.231701:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343e43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8987 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427917.231784:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789427917.231909:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343e43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8987 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.231923:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:2.0:1789427917.231925:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427917.231931:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343e43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8987 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.231944:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02be00, rc 0) 00000100:00100000:2.0:1789427917.232390:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+52:11467:x1876350857193216:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 736us (965us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789427917.232398:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 162 00000100:00100000:2.0:1789427917.239489:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.239598:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857193344 00000100:00100000:1.0:1789427917.239609:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857193344 00000100:00100000:1.0:1789427917.239683:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 163 00000100:00100000:1.0:1789427917.239694:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+52:11467:x1876350857193344:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:1.0:1789427917.239767:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239783:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239795:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239812:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239818:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239825:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239913:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239922:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239928:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427917.239979:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239991:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.239997:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240004:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240009:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427917.240013:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240019:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240031:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:1.0:1789427917.240034:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427917.240038:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240044:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343e51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240056:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240062:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240072:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240077:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427917.240080:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240086:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240093:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933408914600) 00010000:00010000:1.0:1789427917.240095:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427917.240098:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240103:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240117:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240123:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240128:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240133:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427917.240136:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240151:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240159:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427917.240161:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427917.240164:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.240169:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427917.240285:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+52:11467:x1876350857193344:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 592us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427917.240292:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 163 00000100:00100000:0.0:1789427917.246404:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427917.247587:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857193600 00000100:00100000:2.0:1789427917.247601:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857193600 00000100:00100000:2.0:1789427917.247741:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 46 00000100:00100000:2.0:1789427917.247751:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+52:11467:x1876350857193600:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427917.247995:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+53:11467:x1876350857193600:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 245us (1599us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789427917.248022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 46 00000100:00100000:2.0:1789427917.319957:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427917.320240:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857193856 00000100:00100000:3.0:1789427917.320250:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857193856 00000100:00100000:3.0:1789427917.320310:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 164 00000100:00100000:3.0:1789427917.320322:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+53:11470:x1876350857193856:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427917.320347:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427917.320369:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343e66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a898e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320443:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320458:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320479:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320494:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320501:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320523:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320659:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343e7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320669:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320677:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427917.320687:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789427917.320784:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320792:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320799:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320805:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427917.320809:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320816:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320827:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:3.0:1789427917.320830:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427917.320842:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320848:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320874:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320881:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320887:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320893:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427917.320896:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320901:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320912:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933410b41300) 00010000:00010000:3.0:1789427917.320913:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427917.320916:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.320921:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.323255:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343e66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a898e expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.323311:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a898e expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.323321:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:3.0:1789427917.323323:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427917.323327:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030e00, rc 0) 00000100:00100000:3.0:1789427917.323404:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+55:11470:x1876350857193856:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 3083us (3455us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789427917.323414:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 164 00000100:00100000:3.0:1789427917.333657:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427917.333690:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.333769:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857194112 00000100:00100000:1.0:1789427917.333778:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857194112 00000100:00100000:1.0:1789427917.333858:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 165 00000100:00100000:1.0:1789427917.333869:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+55:11470:x1876350857194112:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:1.0:1789427917.333941:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.333959:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.333982:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.334007:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.334034:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.334039:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.334044:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427917.334048:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.334053:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.334062:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:1.0:1789427917.334064:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427917.334067:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.334071:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427917.334152:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+55:11470:x1876350857194112:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 285us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427917.334157:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 165 00000100:00100000:2.0:1789427917.334983:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857193984 00000100:00100000:2.0:1789427917.334991:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857193984 00000100:00100000:2.0:1789427917.335043:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:2.0:1789427917.335052:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+55:2357:x1876350857193984:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427917.335066:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427917.335091:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca343e7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a898e expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.335106:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427917.335110:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427917.335150:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+54:2357:x1876350857193984:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 100us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427917.335158:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:3.0:1789427917.337587:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.337678:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857194368 00000100:00100000:1.0:1789427917.337689:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857194368 00000100:00100000:1.0:1789427917.337743:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00100000:1.0:1789427917.337752:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+54:11470:x1876350857194368:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:1.0:1789427917.338005:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+55:11470:x1876350857194368:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 252us (425us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789427917.338026:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00100000:0.0:1789427917.625331:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427917.625540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857194624 00000100:00100000:2.0:1789427917.625551:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857194624 00000100:00100000:2.0:1789427917.625611:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 166 00000100:00100000:2.0:1789427917.625622:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+55:11488:x1876350857194624:12345-192.168.201.55@tcp:101:cat.0 00010000:00010000:2.0:1789427917.625658:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427917.625678:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343e90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8995 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.625785:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343e97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.625815:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343e97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.625827:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343e97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427917.625840:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789427917.626197:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343e90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8995 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.626219:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343e97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8995 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427917.626228:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:2.0:1789427917.626231:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789427917.626234:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a400, rc 0) 00000100:00100000:2.0:1789427917.626357:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+57:11488:x1876350857194624:12345-192.168.201.55@tcp:101:cat.0 Request processed in 736us (1034us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789427917.626365:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 166 00000100:00100000:3.0:1789427917.681849:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.682271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857194752 00000100:00100000:1.0:1789427917.682284:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857194752 00000100:00100000:1.0:1789427917.682350:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 167 00000100:00100000:1.0:1789427917.682362:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+57:11489:x1876350857194752:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427917.682388:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427917.682409:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a899c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.682488:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343eac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.682502:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.682513:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427917.682548:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789427917.682552:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427917.682570:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.682597:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a899c expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.682617:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343eac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a899c expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.682657:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:1.0:1789427917.682660:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427917.682664:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701000, rc 0) 00000100:00100000:1.0:1789427917.682734:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+58:11489:x1876350857194752:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 374us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427917.682742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 167 00000100:00100000:0.0:1789427917.688418:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.688530:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857195136 00000100:00100000:1.0:1789427917.688540:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857195136 00000100:00100000:1.0:1789427917.688715:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:1.0:1789427917.688727:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+58:11489:x1876350857195136:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:1.0:1789427917.689240:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+59:11489:x1876350857195136:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 514us (831us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789427917.689248:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:2.0:1789427917.692059:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427917.692215:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857195264 00000100:00100000:3.0:1789427917.692225:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857195264 00000100:00100000:3.0:1789427917.692301:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00100000:3.0:1789427917.692311:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+59:11489:x1876350857195264:12345-192.168.201.55@tcp:103:lfs.0 00010000:00010000:3.0:1789427917.692326:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789427917.692352:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8980 expref: 59 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.692376:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343e97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8995 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.692391:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca343d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8941 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427917.692417:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914d00) 00010000:00010000:3.0:1789427917.692429:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427917.692508:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+56:11489:x1876350857195264:12345-192.168.201.55@tcp:103:lfs.0 Request processed in 198us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427917.692517:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00100000:3.0:1789427917.694760:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427917.694912:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857195392 00000100:00100000:0.0:1789427917.694923:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857195392 00000100:00100000:0.0:1789427917.694988:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 168 00000100:00100000:0.0:1789427917.694999:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+56:11489:x1876350857195392:12345-192.168.201.55@tcp:58:lfs.0 00010000:00010000:0.0:1789427917.695125:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.695143:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427917.695155:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789427917.695370:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789427917.695469:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+56:11489:x1876350857195392:12345-192.168.201.55@tcp:58:lfs.0 Request processed in 460us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427917.695477:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 168 00000100:00100000:2.0:1789427917.726510:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427917.726622:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857195520 00000100:00100000:1.0:1789427917.726645:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857195520 00000100:00100000:1.0:1789427917.726711:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 169 00000100:00100000:1.0:1789427917.726720:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+56:11491:x1876350857195520:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427917.726747:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427917.726774:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343eba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.726843:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.726858:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.726886:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.726902:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.726911:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.726917:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727028:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727037:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727051:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427917.727087:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789427917.727091:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427917.727110:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727122:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727130:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727147:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727154:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727160:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427917.727165:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727172:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727225:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:1.0:1789427917.727228:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427917.727233:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727239:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727252:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727257:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727263:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727268:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427917.727278:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727284:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727292:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933408914600) 00010000:00010000:1.0:1789427917.727294:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427917.727298:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727303:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343ec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727335:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343eba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89a3 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727349:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89a3 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427917.727356:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca400) 00010000:00010000:1.0:1789427917.727358:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427917.727360:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701e00, rc 0) 00000100:00100000:1.0:1789427917.727484:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+57:11491:x1876350857195520:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 764us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427917.727491:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 169 00010000:00010000:0.0:1789427918.030074:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789427918.601400:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427918.601411:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427918.601481:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789427918.601488:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427918.601624:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933441bcd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877117184:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789427918.601728:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff933402d1b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789427918.623288:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427918.623393:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933441bcd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877117184:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789427918.627842:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857195648 00000100:00100000:1.0:1789427918.627861:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857195648 00000100:00100000:1.0:1789427918.627965:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 170 00000100:00100000:1.0:1789427918.627977:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+57:11502:x1876350857195648:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789427918.628015:0:5836:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789427918.628152:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+57:11502:x1876350857195648:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 177us (4870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.628159:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 170 00000100:00080000:0.0:1789427918.635653:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427918.644796:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427918.644836:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857195776 00000100:00100000:0.0:1789427918.644846:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857195776 00000100:00100000:0.0:1789427918.644900:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 171 00000100:00100000:0.0:1789427918.644909:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+57:11502:x1876350857195776:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789427918.645083:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645103:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645117:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645239:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645247:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645254:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645282:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645304:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645312:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427918.645354:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789427918.645358:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427918.645372:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645384:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645390:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645397:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645403:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427918.645407:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645415:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645427:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:0.0:1789427918.645430:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427918.645436:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645467:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca343ed6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645478:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645484:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645490:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645495:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427918.645498:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645505:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645513:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9334083ca500) 00010000:00010000:0.0:1789427918.645515:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427918.645518:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645524:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343edd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645538:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645544:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645558:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645563:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427918.645565:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645572:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645579:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca400) 00010000:00010000:0.0:1789427918.645581:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427918.645584:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.645589:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343ee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427918.645665:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+57:11502:x1876350857195776:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 Request processed in 756us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427918.645674:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 171 00000040:00080000:3.0:1789427918.650393:0:12461:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427918.650403:0:12461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427918.650454:0:12461:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789427918.650461:0:12461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427918.651398:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427918.658055:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857196032 00000100:00100000:1.0:1789427918.658071:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857196032 00000100:00100000:1.0:1789427918.658260:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 172 00000100:00100000:1.0:1789427918.658272:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+57:11502:x1876350857196032:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427918.658296:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427918.658320:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343eeb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89aa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658432:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658464:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658476:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427918.658487:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789427918.658599:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658608:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658620:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658635:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427918.658639:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658647:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658660:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca400) 00010000:00010000:1.0:1789427918.658663:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427918.658668:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658674:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658717:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343eeb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89aa expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658727:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:1.0:1789427918.658729:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427918.658733:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343eeb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89aa expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.658742:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701a00, rc 0) 00000100:00100000:1.0:1789427918.658813:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+58:11502:x1876350857196032:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 543us (7424us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1789427918.658821:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 172 00000100:00100000:3.0:1789427918.665192:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427918.665597:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857196160 00000100:00100000:1.0:1789427918.665617:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857196160 00000100:00100000:1.0:1789427918.665679:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 173 00000100:00100000:1.0:1789427918.665690:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+58:11502:x1876350857196160:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789427918.665729:0:5836:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789427918.665854:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+58:11502:x1876350857196160:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 164us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.665863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 173 00000100:00100000:2.0:1789427918.679171:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427918.679464:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857196416 00000100:00100000:3.0:1789427918.679476:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857196416 00000100:00100000:3.0:1789427918.679541:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 174 00000100:00100000:3.0:1789427918.679552:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+58:11502:x1876350857196416:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427918.679576:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427918.679579:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789427918.679607:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343eac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a899c expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.679626:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:3.0:1789427918.679631:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427918.679644:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89b1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427918.680081:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789427918.680349:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343f07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.680365:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.680375:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.680432:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b1 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.680464:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b1 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.680471:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41a00) 00010000:00010000:3.0:1789427918.680474:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427918.680476:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030200, rc 0) 00000100:00100000:3.0:1789427918.680535:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+59:11502:x1876350857196416:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 985us (1375us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789427918.680545:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 174 00000100:00100000:1.0:1789427918.693629:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427918.698275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857196672 00000100:00100000:0.0:1789427918.698296:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857196672 00000100:00100000:0.0:1789427918.698407:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 175 00000100:00100000:0.0:1789427918.698417:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+59:11502:x1876350857196672:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789427918.698490:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427918.698522:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca343f07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b1 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.698556:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41a00) 00010000:00010000:0.0:1789427918.698568:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427918.698595:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.698610:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.698621:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702224:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702254:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702270:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702356:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702363:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702371:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702377:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427918.702382:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702401:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702414:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:0.0:1789427918.702417:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427918.702422:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702428:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca343f15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702650:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702657:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702664:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702669:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427918.702672:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702678:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702687:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xec6e7e4c (ffff9334083ca500) 00010000:00010000:0.0:1789427918.702689:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427918.702692:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427918.702708:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343f1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xec6e7e4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427918.708595:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+58:11502:x1876350857196672:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 10164us (14963us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427918.708611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 175 00000100:00100000:3.0:1789427918.716568:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427918.716605:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857196800 00000100:00100000:3.0:1789427918.716616:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857196800 00000100:00100000:3.0:1789427918.716670:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 176 00000100:00100000:3.0:1789427918.716680:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+58:11502:x1876350857196800:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427918.716701:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427918.716724:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89b8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.716774:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.716789:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.716801:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.716898:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b8 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.716915:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b8 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.716924:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:3.0:1789427918.716927:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789427918.716931:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789427918.716992:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+59:11502:x1876350857196800:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 313us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.716999:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 176 00000100:00100000:3.0:1789427918.722430:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427918.722898:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857197056 00000100:00100000:1.0:1789427918.722910:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857197056 00000100:00100000:1.0:1789427918.722977:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 177 00000100:00100000:1.0:1789427918.722988:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+59:11502:x1876350857197056:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789427918.723094:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.723115:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.723127:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789427918.723655:0:8694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1789427918.723668:0:8694:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373658491941ns, next at 374658488696ns, rc = 0 00000004:00010000:1.0:1789427918.723759:0:8694:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fd3cd070 reply state 000000002bb8f1e6 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427918.723788:0:8694:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789427918.724074:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+61:11502:x1876350857197056:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 1086us (1650us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789427918.724083:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 177 00000100:00100000:0.0:1789427918.727054:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00010000:00010000:3.0:1789427918.727257:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.727271:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.727278:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.727292:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427918.727298:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.727305:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.727323:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:3.0:1789427918.727326:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789427918.727331:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.727337:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343f31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427918.731042:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857197184 00000100:00100000:1.0:1789427918.731058:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857197184 00000100:00100000:1.0:1789427918.731127:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 178 00000100:00100000:1.0:1789427918.731137:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+60:11502:x1876350857197184:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427918.731161:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427918.731203:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89bf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.731267:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89bf expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.731282:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89bf expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.731303:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:1.0:1789427918.731306:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789427918.731310:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700600, rc 0) 00000100:00100000:1.0:1789427918.731379:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+61:11502:x1876350857197184:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 242us (4333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.731387:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 178 00000100:00100000:0.0:1789427918.735623:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427918.735664:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857197312 00000100:00100000:0.0:1789427918.735674:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857197312 00000100:00100000:0.0:1789427918.735741:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00100000:0.0:1789427918.735753:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857197312:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789427918.736110:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857197312:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 359us (494us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789427918.736118:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00080000:0.0:1789427918.736142:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427918.773286:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427918.773423:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857197568 00000100:00100000:1.0:1789427918.773433:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857197568 00000100:00100000:1.0:1789427918.774398:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:1.0:1789427918.774410:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+61:11502:x1876350857197568:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789427918.774733:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+62:11502:x1876350857197568:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 323us (1455us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789427918.774741:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:0.0:1789427918.789965:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427918.790049:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857197824 00000100:00100000:1.0:1789427918.790061:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857197824 00000100:00100000:1.0:1789427918.790128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 179 00000100:00100000:1.0:1789427918.790140:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+62:11502:x1876350857197824:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789427918.790283:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+62:11502:x1876350857197824:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 145us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.790291:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 179 00000100:00100000:2.0:1789427918.793570:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877117312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427918.793654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427918.793763:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877117312 00000100:00100000:1.0:1789427918.793775:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877117312 00000100:00100000:1.0:1789427918.793853:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789427918.793864:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411babb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877117312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789427918.793917:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427918.793968:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411babb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877117312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.793974:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789427918.794027:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877117312:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789427918.795612:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427918.799630:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427918.812658:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857197952 00000100:00100000:1.0:1789427918.812676:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857197952 00000100:00100000:1.0:1789427918.812738:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 180 00000100:00100000:1.0:1789427918.812750:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+62:11502:x1876350857197952:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427918.812787:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427918.812810:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343f3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89c6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.812886:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343f46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.812902:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.812914:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427918.812952:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427918.812969:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.812996:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca343f3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89c6 expref: 64 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.813014:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343f46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89c6 expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427918.813022:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:1.0:1789427918.813025:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789427918.813028:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701c00, rc 0) 00000100:00100000:1.0:1789427918.813093:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+63:11502:x1876350857197952:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 345us (13473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427918.813101:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 180 00000100:00100000:3.0:1789427918.819280:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427918.819414:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857198080 00000100:00100000:2.0:1789427918.819425:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857198080 00000100:00100000:2.0:1789427918.819500:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:2.0:1789427918.819510:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857198080:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427918.819528:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427918.819552:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89cd expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427918.819580:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa880cf, blocks: 0x1 00010000:00010000:2.0:1789427918.819601:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1789427918.819606:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427918.819616:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89cd expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.819637:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89cd expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.819652:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02be00, rc 0) 00000100:00100000:2.0:1789427918.819709:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857198080:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 200us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427918.819717:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:3.0:1789427918.825141:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427918.825194:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857198336 00000100:00100000:3.0:1789427918.825206:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857198336 00000100:00100000:3.0:1789427918.825264:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 181 00000100:00100000:3.0:1789427918.825274:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+63:11502:x1876350857198336:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789427918.825380:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+63:11502:x1876350857198336:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 107us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.825388:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 181 00000100:00100000:2.0:1789427918.829914:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427918.830041:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857198464 00000100:00100000:3.0:1789427918.830051:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857198464 00000100:00100000:3.0:1789427918.830115:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 52 00000100:00100000:3.0:1789427918.830124:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+8:11502:x1876350857198464:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427918.830151:0:8466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427918.830169:0:8466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89d4 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.830222:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89cd expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.830232:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427918.830236:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427918.830242:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 9 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.830276:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89cd expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.830290:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89cd expref: 9 pid: 6682 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427918.830306:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b6c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8466:1876350877117440:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427918.830390:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427918.832904:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427918.832948:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857198592 00000100:00100000:3.0:1789427918.832957:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857198592 00010000:00010000:3.0:1789427918.832994:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89cd expref: 10 pid: 6682 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427918.833042:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 68 00000100:00100000:3.0:1789427918.833051:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e62850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+10:2357:x1876350857198592:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427918.833074:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427918.833097:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89cd expref: 10 pid: 6682 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.833111:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89cd expref: 10 pid: 6682 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.833136:0:11166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427918.833141:0:11166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427918.833150:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 10 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.833160:0:11166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 10 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427918.833223:0:11166:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 10 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427918.833238:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b6c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11166:1876350877117568:192.168.201.55@tcp:105: 00000100:00100000:3.0:1789427918.833311:0:11166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bca80 going to sleep for 11 seconds 00010000:00010000:2.0:1789427918.833819:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045ca184c/0x2bea1a57ca343f4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89cd expref: 10 pid: 6682 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427918.833838:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b6c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8466:1876350877117440:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789427918.833863:0:8466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 9 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.833874:0:8466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030600, rc 0) 00000100:00100000:2.0:1789427918.833916:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+9:11502:x1876350857198464:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 3792us (4014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427918.833924:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 52 00000100:00100000:2.0:1789427918.852308:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b6c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11166:1876350877117568:192.168.201.55@tcp:105: 00010000:00010000:2.0:1789427918.852337:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427918.852408:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e62850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857198592:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 19357us (19512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427918.852419:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 68 00000100:00100000:3.0:1789427918.854006:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427918.856939:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857198720 00000100:00100000:2.0:1789427918.856957:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857198720 00002000:00100000:2.0:1789427918.857026:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93343b6c2680 x1876350857198720/t0(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:164/0 lens 504/0 e 0 to 0 dl 1789427929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427918.857037:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93343b6c2680 with x1876350857198720 ext(0->8) 00002000:00010000:2.0:1789427918.857043:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93343b6c2680 00000100:00100000:2.0:1789427918.857070:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:2.0:1789427918.857079:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857198720:12345-192.168.201.55@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789427918.857562:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+10:2356:x1876350857198720:12345-192.168.201.55@tcp:4:lhsmtool_posix.0 Request processed in 481us (3561us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789427918.857571:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 4 00002000:00100000:2.0:1789427918.857578:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93343b6c2680 x1876350857198720/t4294967314(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:164/0 lens 504/448 e 0 to 0 dl 1789427929 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427918.857587:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93343b6c2680 with x1876350857198720 ext(0->8) 00002000:00010000:2.0:1789427918.857591:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93343b6c2680 00000100:00100000:3.0:1789427918.871999:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427918.872049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857198848 00000100:00100000:3.0:1789427918.872060:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857198848 00000100:00100000:3.0:1789427918.872129:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 182 00000100:00100000:3.0:1789427918.872141:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+63:11502:x1876350857198848:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789427918.915541:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1789427918.915563:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1789427918.982134:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000001:00080000:2.0:1789427918.982153:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1789427918.982162:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789427918.982227:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff933420e9a840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789427918.982234:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e1aaf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff933420e9a9c0 00000020:00080000:2.0:1789427918.982237:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e1aa100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93341dd0dc00 00000004:00080000:2.0:1789427918.982287:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1789427918.982368:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+18:11502:x1876350857198848:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 Request processed in 110222us (110372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427918.982383:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 182 00000020:00080000:3.0:1789427918.982425:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1789427918.982486:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427918.982502:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877117696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789427918.982579:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789427918.982657:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789427918.982724:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877117696 00000100:00100000:2.0:1789427918.982734:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877117696 00000100:00100000:3.0:1789427918.982735:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877117824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789427918.982770:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427918.988728:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877117824 00000100:00100000:2.0:1789427918.988745:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877117824 00000100:00100000:2.0:1789427918.988851:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789427918.988864:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877117696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789427918.989071:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789427918.989091:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789427919 00002000:00010000:2.0:1789427918.989110:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789427918.989112:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789427919 -> 1789427919 00002000:00010000:2.0:1789427918.989115:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789427918.989250:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876350877117696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 389us (6673us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789427918.989258:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789427918.989278:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789427918.989285:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877117824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789427918.989302:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1789427918.989329:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa880cb, atime: 0x6aa880cb, ctime: 0x6aa880cb, blocks: 0xb 00010000:00010000:2.0:1789427918.989337:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.989353:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1789427918.989357:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427918.989364:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.989379:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.989388:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.989395:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.989422:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789427918.989814:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789427918.990571:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93343ae60000/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789427918.990586:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877117696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789427918.991524:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876350877117824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2235us (8749us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789427918.991536:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1789427918.991568:0:7625:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427918.991575:0:7625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.991588:0:7625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789427918.991592:0:7625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.991604:0:7625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.991703:0:7625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.991711:0:7625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045ca184c/0x2bea1a57ca343f5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427918.991739:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427918.991742:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427918.991743:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427918.995331:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1789427918.995346:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1789427918.995378:0:3301:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93343b1b1500 x1876350877117824/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789427934 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789427918.995394:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93343b1b1500/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789427918.995399:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877117824:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789427918.995472:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427918.995610:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857198976 00000100:00100000:2.0:1789427918.995619:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857198976 00000100:00100000:2.0:1789427918.995689:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 55 00000100:00100000:2.0:1789427918.995699:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+10:2357:x1876350857198976:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1789427919.052376:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789427919.072013:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1789427919.072033:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1789427919.072038:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1789427919.072347:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857198976:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 Request processed in 76643us (76873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427919.072358:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 55 00000100:00100000:0.0:1789427919.076032:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427919.076202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857199232 00000100:00100000:3.0:1789427919.076219:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857199232 00000100:00100000:3.0:1789427919.076298:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 183 00000100:00100000:3.0:1789427919.076309:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+18:11502:x1876350857199232:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789427919.076392:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427919.076427:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701c00/0x2bea1a57ca343f46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89c6 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.076461:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:3.0:1789427919.076466:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427919.076502:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.076520:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.076530:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427919.076822:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000058527abe reply state 00000000612de5d2 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.076832:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427919.077007:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+19:11502:x1876350857199232:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 698us (987us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789427919.077016:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 183 00000100:00100000:2.0:1789427919.082569:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427919.083144:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857199360 00000100:00100000:3.0:1789427919.083158:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857199360 00000100:00100000:3.0:1789427919.083270:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 56 00000100:00100000:3.0:1789427919.083282:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857199360:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789427919.083567:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789427919.083571:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789427919 -> 1789427917 00002000:00010000:3.0:1789427919.083574:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789427915 00002000:00010000:3.0:1789427919.083588:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789427919 -> 1789427917 00002000:00010000:3.0:1789427919.083590:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789427919.083658:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857199360:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 377us (1097us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789427919.083667:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 56 00010000:00010000:1.0:1789427919.086637:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.086656:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.086664:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.086671:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427919.086676:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.086684:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.086704:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:1.0:1789427919.086707:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427919.086712:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.086718:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca343f62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.087150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427919.087373:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857199616 00000100:00100000:3.0:1789427919.087383:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857199616 00000100:00100000:3.0:1789427919.087626:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 184 00000100:00100000:3.0:1789427919.087638:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+18:11502:x1876350857199616:12345-192.168.201.55@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789427919.087719:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.087736:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.087744:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.087792:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.087806:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b8 expref: 18 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.087820:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877117952:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427919.087917:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81b240 going to sleep for 11 seconds 00000100:00100000:2.0:1789427919.093405:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427919.093983:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857199744 00000100:00100000:0.0:1789427919.093996:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857199744 00010000:00010000:0.0:1789427919.094047:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b8 expref: 19 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427919.094206:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 69 00000100:00100000:0.0:1789427919.094218:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+19:2356:x1876350857199744:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427919.094247:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427919.094254:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b8 expref: 19 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.094268:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b8 expref: 19 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.094289:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:0.0:1789427919.094294:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.094303:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.094311:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.094333:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427919.094399:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+19:2356:x1876350857199744:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 184us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.094407:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 69 00010000:00010000:3.0:1789427919.095828:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89b8 expref: 18 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.095874:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877117952:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427919.095905:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.097713:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.097728:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.097759:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.097767:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.097775:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.097782:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427919.097787:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.097794:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.097813:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:2.0:1789427919.097816:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789427919.097822:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.097855:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca343f69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.098294:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+17:11502:x1876350857199616:12345-192.168.201.55@tcp:55:lhsmtool_posix.0 Request processed in 10654us (11217us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789427919.098306:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 184 00000100:00100000:2.0:1789427919.104295:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427919.104372:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857199872 00000100:00100000:1.0:1789427919.104382:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857199872 00000100:00100000:1.0:1789427919.104424:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 57 00000100:00100000:1.0:1789427919.104440:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857199872:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789427919.104501:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.104518:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 8 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.104524:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789427919.104528:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427919.104531:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.104568:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 8 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.104583:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 8 pid: 8466 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427919.104600:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876350877118080:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427919.104920:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433efff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427919.110127:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933410062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876350877118080:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427919.110160:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427919.111066:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427919.111418:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857200000 00000100:00100000:3.0:1789427919.111425:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857200000 00010000:00010000:3.0:1789427919.111475:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 9 pid: 8466 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.111515:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 70 00000100:00100000:3.0:1789427919.111522:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857200000:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427919.111535:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427919.111555:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 9 pid: 8466 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.111566:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 9 pid: 8466 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.111587:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca343f54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89d4 expref: 9 pid: 8466 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.111605:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427919.111619:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427919.111626:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.111651:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.111677:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427919.111725:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857200000:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 204us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427919.111730:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 70 00010000:00010000:1.0:1789427919.111875:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.111896:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.111922:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.111942:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.111950:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.111958:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789427919.111962:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.111972:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.111983:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427919.111987:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f665b416/0x2bea1a57ca343f70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427919.112033:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857199872:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 Request processed in 7602us (7749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.112038:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 57 00000100:00100000:2.0:1789427919.115865:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427919.116066:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857200256 00000100:00100000:3.0:1789427919.116087:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857200256 00000100:00100000:3.0:1789427919.116148:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 185 00000100:00100000:3.0:1789427919.116159:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+17:11502:x1876350857200256:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789427919.116278:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.116296:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.116308:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.116583:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.116595:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89bf expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.116604:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.116655:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89bf expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.116669:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89bf expref: 18 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.116683:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877118208:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427919.116775:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789427919.124698:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427919.124781:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857200384 00000100:00100000:0.0:1789427919.124791:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857200384 00010000:00010000:0.0:1789427919.124843:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89bf expref: 19 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427919.124888:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 71 00000100:00100000:0.0:1789427919.124899:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+19:2357:x1876350857200384:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427919.124938:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427919.124946:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89bf expref: 19 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.124960:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89bf expref: 19 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.124981:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:0.0:1789427919.124987:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.124996:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.125004:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.125023:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427919.125300:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+19:2357:x1876350857200384:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 403us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.125306:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 71 00010000:00010000:3.0:1789427919.125848:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca343f38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89bf expref: 18 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.125865:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877118208:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427919.125886:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.125895:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.125901:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789427919.126262:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789427919.126419:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789427919.126480:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789427919.126560:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1876350877118336:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789427919.126611:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427919.126753:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427919.128556:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877118336 00000100:00100000:1.0:1789427919.128571:0:11961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877118336 00000100:00100000:1.0:1789427919.128696:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789427919.128707:0:11961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5835:x1876350877118336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789427919.128835:0:11961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5835:x1876350877118336:12345-0@lo:1000:mdt00_001.0 Request processed in 129us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.128842:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789427919.128913:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789427919.128919:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93343ae60000, transno 4294967315 00000100:00100000:3.0:1789427919.128950:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1876350877118336:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789427919.129518:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1789427919.129604:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1876350877118464:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789427919.129646:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427919.130745:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789427919.130811:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877118464 00000100:00100000:0.0:1789427919.130820:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877118464 00000100:00100000:0.0:1789427919.130863:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427919.130872:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1876350877118464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789427919.131317:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1876350877118464:12345-0@lo:1000:mdt00_001.0 Request processed in 444us (1668us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789427919.131326:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427919.131575:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1876350877118464:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789427919.131617:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131628:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131635:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131641:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427919.131646:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131654:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131670:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:3.0:1789427919.131673:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427919.131679:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131685:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131728:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131734:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131740:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131745:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427919.131748:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131754:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131763:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca400) 00010000:00010000:3.0:1789427919.131766:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427919.131769:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131774:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca343eb3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131794:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131809:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89a3 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131817:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131861:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89a3 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.131875:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89a3 expref: 21 pid: 5835 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.131888:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93340e1cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877118592:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427919.132011:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789427919.138583:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427919.140324:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857200512 00000100:00100000:0.0:1789427919.140343:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857200512 00010000:00010000:0.0:1789427919.140395:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89a3 expref: 22 pid: 5835 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427919.140458:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 72 00000100:00100000:0.0:1789427919.140469:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:2357:x1876350857200512:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427919.140484:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427919.140491:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89a3 expref: 22 pid: 5835 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.140504:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89a3 expref: 22 pid: 5835 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.140527:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca400) 00010000:00010000:0.0:1789427919.140533:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.140543:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.140551:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.140572:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427919.140656:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:2357:x1876350857200512:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 188us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.140663:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 72 00010000:00010000:3.0:1789427919.142577:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca343ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89a3 expref: 21 pid: 5835 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427919.142603:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93340e1cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877118592:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427919.142701:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142807:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142815:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142829:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142837:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142845:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142851:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427919.142856:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142863:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142899:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca400) 00010000:00010000:2.0:1789427919.142901:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427919.142907:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142914:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca343f85 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142926:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.142932:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.143008:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.143014:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427919.143017:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.143023:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.143032:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca400) 00010000:00010000:2.0:1789427919.143035:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789427919.143037:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427919.143043:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427919.144617:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+20:11502:x1876350857200256:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 28445us (28745us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789427919.144631:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 185 00000020:00080000:2.0:1789427919.144638:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789427919.147037:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427919.147053:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427919.147650:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789427919.147660:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789427919.150649:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427919.150724:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857200768 00000100:00100000:3.0:1789427919.150733:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857200768 00000100:00100000:3.0:1789427919.150791:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00100000:3.0:1789427919.150802:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419a95c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+20:11502:x1876350857200768:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789427919.151484:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789427919.151585:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1789427919.151630:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.151647:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.151671:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.151680:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.151687:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.151693:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427919.151704:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789427919.151800:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419a95c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+22:11502:x1876350857200768:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 998us (1159us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789427919.151808:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 50 00000020:00080000:3.0:1789427919.151814:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789427919.152294:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427919.152302:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.152310:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789427919.152314:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.152322:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.152335:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff933410b41500) 00010000:00010000:0.0:1789427919.152338:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789427919.152343:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.152349:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427919.152365:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427919.152366:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427919.152368:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427919.817375:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877118720:0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.817456:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427919.817495:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933301ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877119232:0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.817519:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427919.817543:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427919.817548:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933301ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877118848:0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.817568:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427919.817591:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933301ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877118976:0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.817633:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427919.817673:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427919.817679:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933301ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877119104:0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.817710:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427919.817755:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877118720 00000100:00100000:1.0:1789427919.817763:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877118720 00000100:00100000:1.0:1789427919.817817:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789427919.817827:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877118720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.817873:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877118720:12345-0@lo:400:kworker.0 Request processed in 48us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.817881:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789427919.817911:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877118848 00000100:00100000:1.0:1789427919.817913:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877119360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427919.817915:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877118848 00000100:00100000:0.0:1789427919.817946:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877118976 00000100:00100000:1.0:1789427919.817949:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427919.817949:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877118976 00000100:00100000:0.0:1789427919.817970:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877119104 00000100:00100000:0.0:1789427919.817972:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877119104 00000100:00100000:1.0:1789427919.817975:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877119360 00000100:00100000:1.0:1789427919.817978:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877119360 00000100:00100000:0.0:1789427919.817987:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789427919.817993:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877118848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.817999:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789427919.818005:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877119360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427919.818033:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427919.818033:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877118848:12345-0@lo:400:kworker.0 Request processed in 41us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.818040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789427919.818054:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789427919.818060:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877118976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.818067:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877119360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.818073:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789427919.818087:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877118976:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427919.818092:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789427919.818096:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789427919.818102:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877119104:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789427919.818107:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427919.818129:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877119104:12345-0@lo:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.818135:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789427919.818159:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933301ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877119104:0@lo:400:kworker.0 00000100:00100000:0.0:1789427919.818162:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877119360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427919.818168:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933301ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877118976:0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.818227:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933301ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877118848:0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.818236:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877118720:0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.818270:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877119232 00000100:00100000:1.0:1789427919.818274:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877119232 00000100:00100000:1.0:1789427919.818313:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789427919.818320:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877119232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427919.818355:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877119232:12345-0@lo:400:kworker.0 Request processed in 35us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427919.818360:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789427919.818382:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933301ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877119232:0@lo:400:kworker.0 00010000:00010000:0.0:1789427920.073610:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789427920.671968:0:12515:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427920.671978:0:12515:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427920.672019:0:12515:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789427920.672024:0:12515:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789427920.926273:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427920.926606:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857201024 00000100:00100000:3.0:1789427920.926616:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857201024 00000100:00100000:3.0:1789427920.926681:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 186 00000100:00100000:3.0:1789427920.926691:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:11521:x1876350857201024:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427920.926714:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427920.926734:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89db expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.926844:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.926860:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.926871:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427920.926882:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789427920.927029:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca343f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89db expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.927046:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89db expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427920.927054:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:3.0:1789427920.927057:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789427920.927061:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030400, rc 0) 00000100:00100000:3.0:1789427920.927115:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+24:11521:x1876350857201024:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 426us (855us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789427920.927122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 186 00000100:00080000:1.0:1789427920.927287:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427920.932335:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427920.935019:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857201152 00000100:00100000:1.0:1789427920.935033:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857201152 00000100:00100000:1.0:1789427920.935104:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 187 00000100:00100000:1.0:1789427920.935114:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+24:11521:x1876350857201152:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:1.0:1789427920.935219:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935235:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935248:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935262:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935285:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935292:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935527:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935536:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935543:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789427920.935582:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935594:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935600:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935608:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935614:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427920.935618:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935626:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935646:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:1.0:1789427920.935649:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427920.935655:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935661:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701a00/0x2bea1a57ca343fa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935672:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935678:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935684:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935689:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427920.935692:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935697:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935705:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933408914600) 00010000:00010000:1.0:1789427920.935707:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427920.935710:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935716:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343faf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935740:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935747:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935753:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935758:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427920.935761:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935768:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935776:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff933408914c00) 00010000:00010000:1.0:1789427920.935778:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427920.935781:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427920.935786:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701000/0x2bea1a57ca343fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427920.935872:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+24:11521:x1876350857201152:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 757us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427920.935880:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 187 00000100:00100000:1.0:1789427921.014767:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.015108:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857201408 00000100:00100000:0.0:1789427921.015118:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857201408 00000100:00100000:0.0:1789427921.015204:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 188 00000100:00100000:0.0:1789427921.015215:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+24:11524:x1876350857201408:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427921.015238:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427921.015259:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89e2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015460:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015473:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015482:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015506:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015511:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015515:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015747:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015753:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015757:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427921.015764:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789427921.015840:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015847:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015854:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015860:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427921.015865:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.015881:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016036:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:0.0:1789427921.016039:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427921.016044:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016049:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca343fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016059:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016062:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016066:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016069:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427921.016071:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016074:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016079:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9334083caf00) 00010000:00010000:0.0:1789427921.016080:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427921.016082:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016092:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca343fcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016125:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e2 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016134:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e2 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.016139:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427921.016140:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427921.016142:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179200, rc 0) 00000100:00100000:0.0:1789427921.016302:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+26:11524:x1876350857201408:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 1089us (1545us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789427921.016316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 188 00000100:00100000:1.0:1789427921.022252:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.023679:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857201536 00000100:00100000:0.0:1789427921.023692:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857201536 00000100:00100000:0.0:1789427921.023762:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 189 00000100:00100000:0.0:1789427921.023772:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+26:11524:x1876350857201536:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:0.0:1789427921.023836:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.023852:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.023865:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.023910:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.023916:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.023923:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.023930:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427921.023934:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.023941:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.023954:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427921.023957:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789427921.023962:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.023969:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca343fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.024047:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+26:11524:x1876350857201536:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 276us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427921.024054:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 189 00000100:00100000:2.0:1789427921.026485:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.026668:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857201792 00000100:00100000:3.0:1789427921.026678:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857201792 00000100:00100000:3.0:1789427921.026734:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:3.0:1789427921.026743:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+26:11524:x1876350857201792:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:3.0:1789427921.027502:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+27:11524:x1876350857201792:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 755us (1023us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789427921.027526:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:0.0:1789427921.063370:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427921.063494:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857202048 00000100:00100000:2.0:1789427921.063505:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857202048 00000100:00100000:2.0:1789427921.063848:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 190 00000100:00100000:2.0:1789427921.063861:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+27:11049:x1876350857202048:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:2.0:1789427921.063888:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427921.063925:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343fe7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89e9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.064029:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.064040:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e2 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.064046:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.064073:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e2 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.064082:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e2 expref: 28 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427921.064104:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341de77480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877119488:192.168.201.55@tcp:104: 00000100:00100000:2.0:1789427921.064229:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427921.070495:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341de77480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877119488:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789427921.070528:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.070968:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.071199:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857202176 00000100:00100000:1.0:1789427921.071222:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857202176 00010000:00010000:1.0:1789427921.071259:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e2 expref: 29 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427921.071288:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 73 00000100:00100000:1.0:1789427921.071298:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+29:2357:x1876350857202176:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427921.071311:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427921.071317:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e2 expref: 29 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.071329:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e2 expref: 29 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.071352:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca343fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e2 expref: 29 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.071367:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:1.0:1789427921.071373:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.071383:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.071390:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.071511:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427921.071582:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+28:2357:x1876350857202176:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 276us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427921.071598:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 73 00010000:00010000:2.0:1789427921.074759:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.074778:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427921.074808:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789427921.075383:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca343fe7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e9 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.075423:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e9 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.075432:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:2.0:1789427921.075435:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427921.075438:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a400, rc 0) 00000100:00100000:2.0:1789427921.075553:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+28:11049:x1876350857202048:12345-192.168.201.55@tcp:101:bash.0 Request processed in 11694us (12192us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789427921.075561:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 190 00000100:00100000:0.0:1789427921.081951:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.082165:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857202432 00000100:00100000:1.0:1789427921.082214:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857202432 00000100:00100000:1.0:1789427921.082261:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 191 00000100:00100000:1.0:1789427921.082268:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+28:11049:x1876350857202432:12345-192.168.201.55@tcp:36:bash.0 00010000:00010000:1.0:1789427921.082623:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.082642:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.082652:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427921.082692:0:8694:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1789427921.082709:0:8694:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fb013357 reply state 000000002969666b transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427921.082715:0:8694:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789427921.082746:0:8694:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1789427921.082824:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+32:11049:x1876350857202432:12345-192.168.201.55@tcp:36:bash.0 Request processed in 554us (879us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789427921.082831:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 191 00000020:00080000:1.0:1789427921.082836:0:8694:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789427921.085691:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.085709:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.085716:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.085722:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427921.085727:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.085734:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.085749:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:3.0:1789427921.085752:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427921.085757:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.085763:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca343ffc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.086781:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.087446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857202560 00000100:00100000:3.0:1789427921.087460:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857202560 00000100:00100000:3.0:1789427921.087524:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 192 00000100:00100000:3.0:1789427921.087534:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+31:11049:x1876350857202560:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:3.0:1789427921.087560:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427921.087607:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca344003 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89f0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.087672:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca344003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f0 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.087689:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca344003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f0 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.087707:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:3.0:1789427921.087711:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427921.087714:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789427921.087785:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+32:11049:x1876350857202560:12345-192.168.201.55@tcp:101:bash.0 Request processed in 251us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427921.087792:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 192 00000100:00100000:1.0:1789427921.092442:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.092533:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857202688 00000100:00100000:3.0:1789427921.092544:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857202688 00000100:00100000:3.0:1789427921.092620:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 58 00000100:00100000:3.0:1789427921.092632:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:11049:x1876350857202688:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:3.0:1789427921.092652:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427921.092673:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89f7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427921.092700:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa880cd, atime: 0x6aa880cb, ctime: 0x6aa880cd, blocks: 0xb 00010000:00010000:3.0:1789427921.092723:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1789427921.092727:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427921.092735:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f7 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.092767:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f7 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.092778:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030600, rc 0) 00000100:00100000:3.0:1789427921.092850:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+8:11049:x1876350857202688:12345-192.168.201.55@tcp:101:bash.0 Request processed in 220us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427921.092857:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 58 00000100:00080000:1.0:1789427921.092977:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427921.095787:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00010000:00010000:3.0:1789427921.097598:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427921.098142:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857202816 00000100:00100000:2.0:1789427921.098193:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857202816 00002000:00010000:2.0:1789427921.098242:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789427921.098248:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93343f990700 with x1876350857202816 ext(0->18446744073709551615) 00002000:00010000:2.0:1789427921.098260:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93343f990700. 00000100:00100000:2.0:1789427921.098292:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:2.0:1789427921.098302:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857202816:12345-192.168.201.55@tcp:10:bash.0 00002000:00010000:2.0:1789427921.098748:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789427921.098752:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789427917 -> 1789427921 00002000:00010000:2.0:1789427921.098755:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789427915 -> 1789427915 00002000:00010000:2.0:1789427921.098758:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789427917 -> 1789427921 00002000:00010000:2.0:1789427921.098760:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789427921.098887:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857202816:12345-192.168.201.55@tcp:10:bash.0 Request processed in 585us (3109us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789427921.098911:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 5 00002000:00010000:2.0:1789427921.098915:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789427921.098918:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93343f990700 with x1876350857202816 ext(0->18446744073709551615) 00002000:00010000:2.0:1789427921.098924:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93343f990700. 00000100:00100000:2.0:1789427921.180967:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.181106:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857202944 00000100:00100000:0.0:1789427921.181118:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857202944 00000100:00100000:0.0:1789427921.181202:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 193 00000100:00100000:0.0:1789427921.181212:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+32:11538:x1876350857202944:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:0.0:1789427921.181286:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181303:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181330:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181346:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181354:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181365:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181740:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181750:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181757:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789427921.181805:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181815:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181822:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181828:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181834:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427921.181838:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181846:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181858:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:0.0:1789427921.181861:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427921.181865:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181871:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344011 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181884:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181890:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181961:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181966:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427921.181968:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181972:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181977:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9334083caf00) 00010000:00010000:0.0:1789427921.181979:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427921.181981:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181984:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181996:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.181999:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.182003:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.182006:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427921.182007:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.182018:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.182023:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427921.182024:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427921.182026:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.182029:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca34401f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.182101:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+32:11538:x1876350857202944:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 884us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427921.182110:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 193 00000100:00100000:1.0:1789427921.227727:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.227804:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857203200 00000100:00100000:3.0:1789427921.227822:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857203200 00000100:00100000:3.0:1789427921.227883:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 194 00000100:00100000:3.0:1789427921.227903:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+32:11541:x1876350857203200:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427921.227930:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427921.227952:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344026 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a89fe expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228037:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228055:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228067:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228083:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228106:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228113:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228424:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34403b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228435:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34403b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228443:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34403b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427921.228452:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789427921.228542:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228549:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228556:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228562:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427921.228579:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228587:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228609:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:3.0:1789427921.228612:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427921.228617:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228623:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34402d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228637:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228643:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228649:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228654:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427921.228656:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228662:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228669:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933410b41c00) 00010000:00010000:3.0:1789427921.228672:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427921.228675:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228680:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228733:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344026 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89fe expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228746:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34403b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89fe expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.228753:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:3.0:1789427921.228755:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789427921.228758:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030e00, rc 0) 00000100:00100000:3.0:1789427921.228836:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+34:11541:x1876350857203200:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 944us (1118us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789427921.228844:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 194 00000100:00100000:1.0:1789427921.233113:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.233305:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857203328 00000100:00100000:0.0:1789427921.233315:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857203328 00000100:00100000:0.0:1789427921.233381:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 195 00000100:00100000:0.0:1789427921.233390:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+34:11541:x1876350857203328:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:0.0:1789427921.233465:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.233482:0:8694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e9 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.233492:0:8694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.233522:0:8694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e9 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.233546:0:8694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e9 expref: 34 pid: 5834 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.233560:0:8694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877119616:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427921.233732:0:8694:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410659e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427921.236675:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.236801:0:8694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8694:1876350877119616:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427921.236846:0:8694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427921.237218:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857203584 00000100:00100000:1.0:1789427921.237226:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857203584 00000100:00100000:1.0:1789427921.237284:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 52 00000100:00100000:1.0:1789427921.237293:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+35:5592:x1876350857203584:12345-192.168.201.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789427921.237647:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+36:5592:x1876350857203584:12345-192.168.201.55@tcp:35:ldlm_bl.0 Request processed in 354us (982us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789427921.237655:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 52 00000100:00100000:1.0:1789427921.240565:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.240873:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857203712 00000100:00100000:0.0:1789427921.240887:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857203712 00010000:00010000:0.0:1789427921.241212:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e9 expref: 36 pid: 5834 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.241269:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 74 00000100:00100000:0.0:1789427921.241283:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f992680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+36:2357:x1876350857203712:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427921.241303:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427921.241311:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e9 expref: 36 pid: 5834 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.241324:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e9 expref: 36 pid: 5834 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.241346:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca343fee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89e9 expref: 36 pid: 5834 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.241377:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:0.0:1789427921.241382:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.241391:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.241410:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.241444:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427921.241593:0:8694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.241602:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.241634:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.241641:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.241647:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.241653:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427921.241657:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.241664:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.241674:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:1.0:1789427921.241682:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789427921.241687:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.241693:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.242107:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f992680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+35:2357:x1876350857203712:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 826us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427921.242116:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 74 00000100:00100000:1.0:1789427921.242689:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+34:11541:x1876350857203328:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 9296us (9582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427921.242700:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 195 00000100:00100000:2.0:1789427921.245332:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.245415:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857203968 00000100:00100000:1.0:1789427921.245425:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857203968 00000100:00100000:1.0:1789427921.245488:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 53 00000100:00100000:1.0:1789427921.245497:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+34:11541:x1876350857203968:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:1.0:1789427921.245723:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+35:11541:x1876350857203968:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 227us (400us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789427921.245731:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 53 00000100:00100000:1.0:1789427921.351770:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427921.352993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857204224 00000100:00100000:2.0:1789427921.353006:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857204224 00000100:00100000:2.0:1789427921.353072:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 196 00000100:00100000:2.0:1789427921.353082:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+35:11552:x1876350857204224:12345-192.168.201.55@tcp:101:cat.0 00010000:00010000:2.0:1789427921.353108:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427921.353130:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.353295:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.353316:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.353328:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.353343:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.353351:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.353359:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.353766:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca344065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.353776:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca344065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.353783:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca344065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427921.353793:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789427921.356772:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.356785:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.356802:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.356807:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427921.356810:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358032:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358048:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:2.0:1789427921.358050:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427921.358055:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358060:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358074:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358078:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358082:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358085:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401491600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427921.358087:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358102:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358107:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9334220b8100) 00010000:00010000:2.0:1789427921.358109:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427921.358110:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358113:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34405e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358163:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a05 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358206:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca344065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a05 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.358211:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:2.0:1789427921.358213:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427921.358214:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401490a00, rc 0) 00000100:00100000:2.0:1789427921.358417:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+37:11552:x1876350857204224:12345-192.168.201.55@tcp:101:cat.0 Request processed in 5333us (6653us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789427921.358426:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 196 00000100:00100000:3.0:1789427921.368780:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.369462:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857204480 00000100:00100000:1.0:1789427921.369475:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857204480 00000100:00100000:1.0:1789427921.369546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 54 00000100:00100000:1.0:1789427921.369556:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+37:11552:x1876350857204480:12345-192.168.201.55@tcp:35:cat.0 00000100:00100000:1.0:1789427921.369820:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+38:11552:x1876350857204480:12345-192.168.201.55@tcp:35:cat.0 Request processed in 264us (1049us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789427921.369828:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 54 00000100:00100000:1.0:1789427921.396992:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427921.397213:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857204736 00000100:00100000:2.0:1789427921.397225:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857204736 00000100:00100000:2.0:1789427921.397281:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 197 00000100:00100000:2.0:1789427921.397291:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+38:11553:x1876350857204736:12345-192.168.201.55@tcp:36:rm.0 00010000:00010000:2.0:1789427921.397373:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789427921.397439:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca344065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a05 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397464:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34403b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89fe expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397477:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca344003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f0 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397487:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334083ca000) 00010000:00010000:2.0:1789427921.397500:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427921.397519:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397531:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397539:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397554:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397560:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397579:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397811:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397820:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.397827:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789427921.398384:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789427921.398403:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376333226778ns, next at 377333223928ns, rc = 0 00010000:00010000:2.0:1789427921.398472:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398482:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398491:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398499:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398505:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398511:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398525:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789427921.398545:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398556:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398562:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398567:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427921.398572:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398579:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398589:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334220b8000) 00010000:00010000:2.0:1789427921.398591:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789427921.398595:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398600:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344081 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398617:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398623:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398629:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398634:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401491c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427921.398642:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398648:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398656:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:2.0:1789427921.398658:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427921.398661:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.398667:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca344073 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427921.398677:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dd9ab7af reply state 00000000410da596 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427921.398684:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427921.398768:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+37:11553:x1876350857204736:12345-192.168.201.55@tcp:36:rm.0 Request processed in 1476us (1785us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789427921.398776:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 197 00010000:00010000:0.0:1789427921.399420:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427921.399428:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.399436:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789427921.399439:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.399446:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.399457:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9334220b8000) 00010000:00010000:0.0:1789427921.399459:0:7626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789427921.399462:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.399481:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca344088 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.399497:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427921.399499:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427921.399500:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427921.406563:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.406604:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.406612:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.406619:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401491600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427921.406624:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.406632:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.406649:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9334220b8100) 00010000:00010000:1.0:1789427921.406653:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427921.406657:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.406664:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34407a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427921.470041:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.470289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857204992 00000100:00100000:3.0:1789427921.470300:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857204992 00000100:00100000:3.0:1789427921.470370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 198 00000100:00100000:3.0:1789427921.470381:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+36:11559:x1876350857204992:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:3.0:1789427921.470418:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427921.470439:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca34408f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a0c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.470560:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.470574:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.470602:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.470617:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.470624:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.470630:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789427921.471343:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789427921.471527:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471538:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471546:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471581:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471589:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471596:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471603:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427921.471615:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471625:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471638:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:3.0:1789427921.471642:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427921.471648:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471655:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344096 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427921.471670:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e4ea2841 reply state 00000000a4c821f4 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427921.471679:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789427921.471712:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca34408f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a0c expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471728:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a0c expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.471736:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933410b41b00) 00010000:00010000:3.0:1789427921.471739:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789427921.471741:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789427921.472127:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+39:11559:x1876350857204992:12345-192.168.201.55@tcp:101:bash.0 Request processed in 1746us (2093us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789427921.472136:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 198 00010000:00010000:3.0:1789427921.475419:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.475440:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.475450:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.475456:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427921.475461:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.475470:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.475486:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933410b41c00) 00010000:00010000:3.0:1789427921.475489:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427921.475495:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.475502:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca34409d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427921.478024:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427921.478676:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857205120 00000100:00100000:2.0:1789427921.478687:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857205120 00000100:00100000:2.0:1789427921.478773:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 59 00000100:00100000:2.0:1789427921.478784:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857205120:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:2.0:1789427921.478802:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427921.478822:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a13 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427921.478850:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789427921.478902:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1789427921.478907:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427921.478918:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a13 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.478940:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a13 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.478954:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a400, rc 0) 00000100:00100000:2.0:1789427921.479023:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857205120:12345-192.168.201.55@tcp:101:bash.0 Request processed in 241us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.479032:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 59 00000100:00080000:0.0:1789427921.479351:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427921.485994:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.486081:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857205248 00000100:00100000:3.0:1789427921.486090:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857205248 00000100:00100000:3.0:1789427921.486156:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 60 00000100:00100000:3.0:1789427921.486167:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:11559:x1876350857205248:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:3.0:1789427921.486212:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427921.486231:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a1a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.486277:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a13 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.486286:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427921.486291:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427921.486296:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.486329:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a13 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.486342:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a13 expref: 7 pid: 6682 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427921.486356:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b0a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876350877119744:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427921.486457:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427921.490079:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.490164:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857205376 00000100:00100000:0.0:1789427921.490199:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857205376 00010000:00010000:0.0:1789427921.490236:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a13 expref: 8 pid: 6682 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.490282:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 75 00000100:00100000:0.0:1789427921.490291:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857205376:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427921.490304:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427921.490327:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a13 expref: 8 pid: 6682 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.490341:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a13 expref: 8 pid: 6682 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.490365:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427921.490369:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789427921.490377:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.490417:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.490453:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427921.490467:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1876350877119872:192.168.201.55@tcp:105: 00000100:00100000:0.0:1789427921.490529:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410659e40 going to sleep for 11 seconds 00010000:00010000:3.0:1789427921.490615:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af88caba/0x2bea1a57ca3440b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a13 expref: 8 pid: 6682 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427921.490630:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b0a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876350877119744:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427921.490651:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.490660:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031800, rc 0) 00000100:00100000:3.0:1789427921.490689:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:11559:x1876350857205248:12345-192.168.201.55@tcp:101:bash.0 Request processed in 4525us (4706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427921.490697:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 60 00000100:00100000:2.0:1789427921.494929:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.495066:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857205632 00000100:00100000:1.0:1789427921.495086:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857205632 00000100:00100000:1.0:1789427921.495149:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 55 00000100:00100000:1.0:1789427921.495158:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+38:11559:x1876350857205632:12345-192.168.201.55@tcp:35:bash.0 00000100:00100000:1.0:1789427921.495538:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+39:11559:x1876350857205632:12345-192.168.201.55@tcp:35:bash.0 Request processed in 372us (609us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789427921.495546:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 55 00000100:00100000:0.0:1789427921.495752:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f954a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1876350877119872:192.168.201.55@tcp:105: 00010000:00010000:0.0:1789427921.495777:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427921.495800:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857205376:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 5510us (5730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427921.495807:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 75 00000100:00100000:2.0:1789427921.710233:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.710630:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857205760 00000100:00100000:0.0:1789427921.710642:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857205760 00000100:00100000:0.0:1789427921.710712:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 199 00000100:00100000:0.0:1789427921.710724:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+39:11575:x1876350857205760:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427921.710749:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427921.710769:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3440c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a21 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.710845:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca3440c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.710861:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca3440c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.711091:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca3440c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427921.711132:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789427921.711136:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427921.711154:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca3440c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.711205:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3440c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a21 expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.711226:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca3440c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a21 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.711234:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:0.0:1789427921.711237:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427921.711241:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179c00, rc 0) 00000100:00100000:0.0:1789427921.711309:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+40:11575:x1876350857205760:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 586us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427921.711317:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 199 00000100:00100000:2.0:1789427921.721125:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.721255:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857206016 00000100:00100000:0.0:1789427921.721266:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857206016 00000100:00100000:0.0:1789427921.721332:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 200 00000100:00100000:0.0:1789427921.721343:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+40:11575:x1876350857206016:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427921.721365:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427921.721399:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3440ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a28 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.721525:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3440d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.721539:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3440d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.721551:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3440d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427921.721576:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789427921.721702:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca3440ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a28 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.721720:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3440d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a28 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.721729:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933410b41b00) 00010000:00010000:0.0:1789427921.721732:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427921.721737:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178a00, rc 0) 00000100:00100000:0.0:1789427921.721799:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+42:11575:x1876350857206016:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 457us (683us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789427921.721806:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 200 00000100:00100000:2.0:1789427921.727240:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427921.727367:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.727627:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857206400 00000100:00100000:3.0:1789427921.727637:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857206400 00000100:00100000:3.0:1789427921.727707:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:3.0:1789427921.727718:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+42:2357:x1876350857206400:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427921.727734:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427921.727757:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca3440d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a28 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.727774:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933410b41b00) 00010000:00010000:3.0:1789427921.727779:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427921.727851:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+41:2357:x1876350857206400:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 135us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427921.727858:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:1.0:1789427921.728907:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857206272 00000100:00100000:1.0:1789427921.728917:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857206272 00000100:00100000:1.0:1789427921.728969:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 201 00000100:00100000:1.0:1789427921.728978:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+41:11575:x1876350857206272:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:1.0:1789427921.729003:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427921.729024:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3440e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a2f expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.729359:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3440ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.729376:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3440ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.729396:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3440ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427921.729409:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789427921.729541:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca3440e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a2f expref: 44 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.729559:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3440ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a2f expref: 43 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.729566:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933410b41b00) 00010000:00010000:1.0:1789427921.729581:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789427921.729585:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700e00, rc 0) 00000100:00100000:1.0:1789427921.729647:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+43:11575:x1876350857206272:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 669us (2417us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789427921.729671:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 201 00000100:00100000:2.0:1789427921.742233:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.742336:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857206528 00000100:00100000:1.0:1789427921.742348:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857206528 00000100:00100000:1.0:1789427921.742420:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 61 00000100:00100000:1.0:1789427921.742432:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+6:2356:x1876350857206528:12345-192.168.201.55@tcp:1:lfs.0 00010000:00010000:1.0:1789427921.742485:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.742509:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.742519:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427921.742525:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427921.742532:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.742582:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.742598:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 6 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427921.742613:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876350877120000:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427921.742714:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427921.745602:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.745697:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857206656 00000100:00100000:3.0:1789427921.745709:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857206656 00002000:00100000:3.0:1789427921.745765:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93344198f100 x1876350857206656/t0(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:167/0 lens 504/0 e 0 to 0 dl 1789427932 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789427921.745777:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93344198f100 with x1876350857206656 ext(0->8) 00010000:00010000:3.0:1789427921.745786:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 7 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.745803:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 7 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427921.745839:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93344198f100 00000100:00100000:3.0:1789427921.745884:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:3.0:1789427921.745896:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857206656:12345-192.168.201.55@tcp:4:lfs.0 00000100:00100000:3.0:1789427921.746513:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857206656:12345-192.168.201.55@tcp:4:lfs.0 Request processed in 612us (915us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789427921.746523:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 3 00002000:00100000:3.0:1789427921.746531:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93344198f100 x1876350857206656/t4294967308(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:167/0 lens 504/448 e 0 to 0 dl 1789427932 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789427921.746540:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93344198f100 with x1876350857206656 ext(0->8) 00010000:00010000:3.0:1789427921.746546:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 9 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.746561:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 9 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427921.746569:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93344198f100 00000100:00100000:1.0:1789427921.746702:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876350877120000:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427921.746738:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427921.762803:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.762939:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857206784 00000100:00100000:1.0:1789427921.762952:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857206784 00010000:00010000:1.0:1789427921.762994:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 9 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427921.763045:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 76 00000100:00100000:1.0:1789427921.763056:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+9:2357:x1876350857206784:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789427921.763072:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789427921.763095:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789427921.763098:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789427921 00002000:00010000:1.0:1789427921.763101:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789427922 00002000:00010000:1.0:1789427921.763103:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789427921 00010000:00010000:1.0:1789427921.763109:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 9 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.763124:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 9 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.763164:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc60fe64/0x2bea1a57ca3440b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a1a expref: 9 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.763225:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427921.763231:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789427921.763255:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.763267:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.763298:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427921.763533:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.763545:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.763584:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.763593:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.763603:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.763611:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789427921.763616:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.763625:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.763639:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.763647:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca3440f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427921.763740:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857206528:12345-192.168.201.55@tcp:1:lfs.0 Request processed in 21309us (21517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.763749:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 61 00000100:00100000:1.0:1789427921.765037:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857206784:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 1972us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427921.765050:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 76 00000100:00100000:2.0:1789427921.776413:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.776473:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857207040 00000100:00100000:1.0:1789427921.776485:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857207040 00000100:00100000:1.0:1789427921.776554:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 56 00000100:00100000:1.0:1789427921.776565:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419a97450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+43:11575:x1876350857207040:12345-192.168.201.55@tcp:35:lfs.0 00000004:00010000:1.0:1789427921.776639:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3440ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a2f expref: 43 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427921.776930:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1789427921.776974:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789427921.777488:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1789427921.777551:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.777571:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a0c expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.777582:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.777643:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a0c expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.777658:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a0c expref: 47 pid: 5835 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427921.777676:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1876350877120128:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427921.777770:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427921.787907:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.787953:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1876350877120128:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789427921.787986:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427921.788586:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857207168 00000100:00100000:2.0:1789427921.788595:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857207168 00010000:00010000:2.0:1789427921.788636:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a0c expref: 48 pid: 5835 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427921.788668:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 77 00000100:00100000:2.0:1789427921.788677:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+48:2357:x1876350857207168:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427921.788693:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427921.788700:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a0c expref: 48 pid: 5835 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.788712:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a0c expref: 48 pid: 5835 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.788732:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3440a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a0c expref: 48 pid: 5835 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.788749:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933410b41b00) 00010000:00010000:2.0:1789427921.788755:0:11166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.788765:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.788772:0:11166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427921.788804:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427921.788893:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+47:2357:x1876350857207168:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 215us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.788901:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 77 00010000:00010000:1.0:1789427921.789028:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.789036:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789427921.789169:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789427921.789404:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1789427921.789514:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1876350877120256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789427921.789583:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427921.789617:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427921.789925:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877120256 00000100:00100000:2.0:1789427921.789931:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877120256 00000100:00100000:2.0:1789427921.789964:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789427921.789970:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1876350877120256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789427921.790023:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1876350877120256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 54us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427921.790028:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789427921.791211:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789427921.791427:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1876350877120256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789427921.791912:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789427921.791981:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1876350877120384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789427921.792033:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427921.792066:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427921.792084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877120384 00000100:00100000:2.0:1789427921.792091:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877120384 00000100:00100000:2.0:1789427921.792203:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789427921.792214:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5838:x1876350877120384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789427921.792414:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1876350877120384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 201us (378us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789427921.792421:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789427921.792482:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1876350877120384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789427921.792534:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789427921.792581:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.792592:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.792602:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.792609:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427921.792614:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.792622:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.792639:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933410b41b00) 00010000:00010000:1.0:1789427921.792643:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789427921.792648:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427921.792654:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca3440ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789427921.792793:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789427921.792865:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1789427921.792873:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376727697127ns, next at 377727695624ns, rc = 0 00000001:00080000:1.0:1789427921.792896:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789427921.792920:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff933410b41b00) 00010000:00010000:1.0:1789427921.792922:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789427921.792927:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700e00/0x2bea1a57ca3440ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a2f expref: 51 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427921.793014:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419a97450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+50:11575:x1876350857207040:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 16451us (16616us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789427921.793020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 56 00000020:00080000:1.0:1789427921.793023:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789427921.795535:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.795583:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857207296 00000100:00100000:0.0:1789427921.795593:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857207296 00000100:00100000:0.0:1789427921.795696:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 202 00000100:00100000:0.0:1789427921.795707:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+50:11575:x1876350857207296:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427921.795745:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427921.795767:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344106 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a36 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.795824:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a36 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.795841:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a36 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.795860:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427921.795863:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427921.795867:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178400, rc 0) 00000100:00100000:0.0:1789427921.795930:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+51:11575:x1876350857207296:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 225us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427921.795938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 202 00000100:00100000:0.0:1789427921.798830:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.798970:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857207552 00000100:00100000:3.0:1789427921.798979:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857207552 00000100:00100000:3.0:1789427921.799028:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 57 00000100:00100000:3.0:1789427921.799036:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+51:11575:x1876350857207552:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:3.0:1789427921.799322:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+52:11575:x1876350857207552:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 285us (500us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789427921.799347:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 57 00000100:00100000:2.0:1789427921.881512:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427921.881565:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427921.881659:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857207680 00000100:00100000:1.0:1789427921.881670:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857207680 00000100:00100000:1.0:1789427921.881723:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 302 00000100:00100000:1.0:1789427921.881734:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857207680:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427921.881803:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857207680:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 70us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427921.881810:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 302 00000100:00100000:0.0:1789427921.881954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857207808 00000100:00100000:0.0:1789427921.881958:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857207808 00000100:00100000:0.0:1789427921.882013:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 169 00000100:00100000:0.0:1789427921.882021:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857207808:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789427921.882054:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2355:x1876350857207808:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 36us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427921.882061:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 169 00000100:00080000:1.0:1789427921.882191:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427921.912957:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.913036:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857207936 00000100:00100000:3.0:1789427921.913046:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857207936 00000100:00100000:3.0:1789427921.913114:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 203 00000100:00100000:3.0:1789427921.913125:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+52:11585:x1876350857207936:12345-192.168.201.55@tcp:34:lfs.0 00010000:00010000:3.0:1789427921.913244:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913261:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913272:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913288:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913295:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913302:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913398:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913407:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913414:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789427921.913473:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913486:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913492:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913499:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913505:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427921.913509:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913517:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913529:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:3.0:1789427921.913532:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427921.913537:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913543:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca34410d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913569:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913575:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913587:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913592:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427921.913595:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913601:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913614:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff933410b41c00) 00010000:00010000:3.0:1789427921.913616:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427921.913619:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913625:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca344114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913641:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913647:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913653:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913656:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427921.913658:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913673:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913681:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427921.913683:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427921.913687:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.913691:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca34411b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427921.913773:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+52:11585:x1876350857207936:12345-192.168.201.55@tcp:34:lfs.0 Request processed in 648us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427921.913781:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 203 00000100:00100000:3.0:1789427921.971237:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427921.971446:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857208192 00000100:00100000:0.0:1789427921.971458:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857208192 00000100:00100000:0.0:1789427921.971529:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 204 00000100:00100000:0.0:1789427921.971547:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+52:11588:x1876350857208192:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427921.971572:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427921.971593:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca344122 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a3d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971667:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971682:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971693:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971707:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971713:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971720:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971852:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca344137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971860:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca344137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971867:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca344137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427921.971886:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789427921.971983:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971991:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.971997:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972003:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427921.972007:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972014:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972025:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:0.0:1789427921.972028:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427921.972032:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972038:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344129 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972050:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972056:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972070:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972075:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427921.972078:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972085:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972093:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9334083ca500) 00010000:00010000:0.0:1789427921.972095:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427921.972098:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972104:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972147:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca344122 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a3d expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972163:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca344137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a3d expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427921.972170:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427921.972172:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427921.972226:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179200, rc 0) 00000100:00100000:0.0:1789427921.972287:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+54:11588:x1876350857208192:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 741us (1061us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789427921.972302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 204 00000100:00100000:2.0:1789427921.974801:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427921.989861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857208320 00000100:00100000:3.0:1789427921.989880:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857208320 00000100:00100000:3.0:1789427921.989966:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 205 00000100:00100000:3.0:1789427921.989977:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+54:11588:x1876350857208320:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:3.0:1789427921.990045:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.990064:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.990076:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.990104:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.990129:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.990136:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.990142:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427921.990147:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.990154:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.990167:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427921.990170:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789427921.990191:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427921.990198:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427921.990287:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+54:11588:x1876350857208320:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 311us (15496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427921.990295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 205 00000100:00100000:0.0:1789427921.996546:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427921.996658:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857208576 00000100:00100000:2.0:1789427921.996669:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857208576 00000100:00100000:2.0:1789427921.996738:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 58 00000100:00100000:2.0:1789427921.996749:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+54:11588:x1876350857208576:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789427921.997008:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+55:11588:x1876350857208576:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 260us (477us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789427921.997034:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 58 00000100:00100000:1.0:1789427922.118428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427922.118540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857208832 00000100:00100000:0.0:1789427922.118552:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857208832 00000100:00100000:0.0:1789427922.118671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 206 00000100:00100000:0.0:1789427922.118692:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+55:11598:x1876350857208832:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:0.0:1789427922.118724:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427922.118728:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789427922.118763:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca3440c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a21 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.118788:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:0.0:1789427922.118793:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789427922.118809:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca34414c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.119165:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.119216:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.119227:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427922.119237:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789427922.119355:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca34414c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.119402:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.119410:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427922.119413:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427922.119416:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179e00, rc 0) 00000100:00100000:0.0:1789427922.119491:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+56:11598:x1876350857208832:12345-192.168.201.55@tcp:101:bash.0 Request processed in 810us (1074us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789427922.119498:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 206 00000100:00100000:2.0:1789427922.123468:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427922.123531:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427922.123689:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857209216 00000100:00100000:3.0:1789427922.123701:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857209216 00000100:00100000:3.0:1789427922.123783:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 207 00000100:00100000:3.0:1789427922.123795:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+56:11598:x1876350857209216:12345-192.168.201.55@tcp:36:bash.0 00010000:00010000:3.0:1789427922.123909:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427922.123955:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca344137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a3d expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.123975:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427922.123981:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427922.124486:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.124502:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.124512:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.124548:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.124867:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 56 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427922.124942:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877120512:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427922.125042:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789427922.128724:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857208960 00000100:00100000:0.0:1789427922.128741:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857208960 00010000:00010000:0.0:1789427922.128800:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 57 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.128865:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 78 00000100:00100000:0.0:1789427922.128884:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+57:2356:x1876350857208960:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427922.128904:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427922.128912:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 57 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.128926:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 57 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.128947:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427922.128953:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.128978:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.128986:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.129006:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427922.129059:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+57:2356:x1876350857208960:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 184us (5600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.129066:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 78 00000100:00080000:1.0:1789427922.131393:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789427922.131518:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427922.131802:0:5834:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.55@tcp) returned -22 from blocking AST (req@0000000050c97c05 x1876350877120512) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 56 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.131965:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a44 expref: 56 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427922.131985:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877120512:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789427922.132008:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:2.0:1789427922.132017:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.132027:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.132034:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789427922.132417:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1789427922.132471:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ab71115 reply state 00000000406737c8 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427922.132480:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427922.132720:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+57:11598:x1876350857209216:12345-192.168.201.55@tcp:36:bash.0 Request processed in 8925us (9187us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789427922.132729:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 207 00000020:00080000:2.0:1789427922.132750:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789427922.136908:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00010000:00010000:1.0:1789427922.136987:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.137001:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.137010:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.137039:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427922.137045:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.137055:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.137085:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:1.0:1789427922.137089:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427922.137095:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427922.137101:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca344161 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427922.137204:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857209344 00000100:00100000:2.0:1789427922.137217:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857209344 00000100:00100000:2.0:1789427922.137289:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 208 00000100:00100000:2.0:1789427922.137304:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+56:11598:x1876350857209344:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:2.0:1789427922.137330:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427922.137353:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a4b expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.137449:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.137463:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.137473:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427922.137502:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789427922.137507:0:8694:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427922.137527:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.137568:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a4b expref: 58 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.137583:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a4b expref: 57 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.137589:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:2.0:1789427922.137600:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427922.137602:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02be00, rc 0) 00000100:00100000:2.0:1789427922.138941:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+57:11598:x1876350857209344:12345-192.168.201.55@tcp:101:bash.0 Request processed in 1632us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427922.138954:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 208 00000100:00100000:3.0:1789427922.142360:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427922.142441:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857209600 00000100:00100000:2.0:1789427922.142455:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857209600 00000100:00100000:2.0:1789427922.142514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 59 00000100:00100000:2.0:1789427922.142523:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+57:11598:x1876350857209600:12345-192.168.201.55@tcp:35:bash.0 00000100:00100000:2.0:1789427922.142787:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+58:11598:x1876350857209600:12345-192.168.201.55@tcp:35:bash.0 Request processed in 264us (436us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789427922.142795:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 59 00000100:00100000:0.0:1789427922.222003:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427922.222122:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857209728 00000100:00100000:2.0:1789427922.222135:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857209728 00000100:00100000:2.0:1789427922.222248:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 209 00000100:00100000:2.0:1789427922.222259:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+58:11604:x1876350857209728:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427922.222290:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427922.222319:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a52 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.222436:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34417d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.222452:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34417d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.222465:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34417d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427922.222523:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789427922.222527:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427922.222546:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34417d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.222573:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca344176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a52 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.222592:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34417d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a52 expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.222600:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:2.0:1789427922.222603:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427922.222608:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401491600, rc 0) 00000100:00100000:2.0:1789427922.222685:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+59:11604:x1876350857209728:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 428us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427922.222693:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 209 00000100:00100000:3.0:1789427922.228040:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427922.228216:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857209856 00000100:00100000:0.0:1789427922.228227:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857209856 00000100:00100000:0.0:1789427922.228303:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 210 00000100:00100000:0.0:1789427922.228314:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+59:11604:x1876350857209856:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427922.228339:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427922.228362:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca344184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a59 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228444:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228460:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228471:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228505:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228512:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228519:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228621:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228631:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228638:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427922.228683:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789427922.228688:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789427922.228709:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228721:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228729:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228736:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228754:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228760:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427922.228765:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228773:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228787:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:0.0:1789427922.228791:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.228798:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228804:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca34418b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228819:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228826:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228832:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228837:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427922.228840:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228857:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228865:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9334083ca500) 00010000:00010000:0.0:1789427922.228868:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427922.228871:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228876:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca344192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228910:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca344184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a59 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228924:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a59 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.228931:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427922.228933:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427922.228936:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179e00, rc 0) 00000100:00100000:0.0:1789427922.229012:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+60:11604:x1876350857209856:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 699us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.229020:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 210 00000100:00100000:1.0:1789427922.235428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427922.235641:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427922.235732:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857210240 00000100:00100000:3.0:1789427922.235744:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857210240 00000100:00100000:3.0:1789427922.235834:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:3.0:1789427922.235844:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+60:2357:x1876350857210240:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427922.235881:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427922.235908:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca344199 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a59 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.235929:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427922.235935:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427922.236003:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+59:2357:x1876350857210240:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427922.236011:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:2.0:1789427922.237750:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857210112 00000100:00100000:2.0:1789427922.237768:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857210112 00000100:00100000:2.0:1789427922.237994:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 211 00000100:00100000:2.0:1789427922.238006:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+59:11604:x1876350857210112:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789427922.238029:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427922.238048:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a60 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.238172:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.238211:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a4b expref: 60 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.238220:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.238253:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a4b expref: 60 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.238266:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a4b expref: 60 pid: 8694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427922.238279:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877120640:192.168.201.55@tcp:104: 00000100:00100000:2.0:1789427922.238387:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427922.242015:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877120640:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789427922.242048:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427922.243560:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427922.243664:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857210368 00000100:00100000:0.0:1789427922.243674:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857210368 00010000:00010000:0.0:1789427922.243718:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a4b expref: 61 pid: 8694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427922.243777:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 79 00000100:00100000:0.0:1789427922.243787:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+61:2355:x1876350857210368:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427922.243802:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427922.243809:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a4b expref: 61 pid: 8694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.243833:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a4b expref: 61 pid: 8694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.243854:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca34416f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a4b expref: 61 pid: 8694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.243880:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427922.243885:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.243896:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.243904:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427922.243935:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427922.243998:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+60:2355:x1876350857210368:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 212us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427922.244006:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 79 00010000:00010000:2.0:1789427922.244124:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.244133:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427922.244154:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789427922.244350:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a60 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.244392:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a60 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.244400:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:2.0:1789427922.244402:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789427922.244405:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933401490a00, rc 0) 00000100:00100000:2.0:1789427922.244434:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+60:11604:x1876350857210112:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 6431us (9018us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789427922.244440:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 211 00000100:00100000:1.0:1789427922.252157:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427922.252455:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857210624 00000100:00100000:3.0:1789427922.252469:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857210624 00000100:00100000:3.0:1789427922.252584:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:3.0:1789427922.252596:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+60:11604:x1876350857210624:12345-192.168.201.55@tcp:103:lfs.0 00010000:00010000:3.0:1789427922.252617:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427922.252645:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178400/0x2bea1a57ca344106 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a36 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.252665:0:11166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427922.252671:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427922.252731:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+59:11604:x1876350857210624:12345-192.168.201.55@tcp:103:lfs.0 Request processed in 138us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427922.252738:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:1.0:1789427922.256451:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427922.256523:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857210752 00000100:00100000:2.0:1789427922.256533:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857210752 00000100:00100000:2.0:1789427922.256598:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 212 00000100:00100000:2.0:1789427922.256608:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+59:11604:x1876350857210752:12345-192.168.201.55@tcp:58:lfs.0 00010000:00010000:2.0:1789427922.256706:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.256723:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427922.256734:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789427922.256947:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789427922.257217:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+59:11604:x1876350857210752:12345-192.168.201.55@tcp:58:lfs.0 Request processed in 608us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427922.257225:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 212 00000100:00100000:2.0:1789427922.259928:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427922.260003:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857210880 00000100:00100000:3.0:1789427922.260014:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857210880 00000100:00100000:3.0:1789427922.260072:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 213 00000100:00100000:3.0:1789427922.260082:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+59:11604:x1876350857210880:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789427922.260113:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427922.260134:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3441bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a67 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.260211:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.260222:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3441bc lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a67 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.260238:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.260251:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3441bc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a67 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.260264:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427922.260267:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427922.260271:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3441bc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a67 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427922.260278:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031e00, rc 0) 00000100:00100000:3.0:1789427922.261037:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+60:11604:x1876350857210880:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 949us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427922.261048:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 213 00010000:00010000:0.0:1789427923.149818:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789427923.273742:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427923.273754:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427923.273796:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789427923.273803:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427923.273975:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877120768:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789427923.274121:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427923.280352:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877120768:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789427923.290569:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.293527:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857211008 00000100:00100000:2.0:1789427923.293549:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857211008 00000100:00100000:2.0:1789427923.293638:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 214 00000100:00100000:2.0:1789427923.293650:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+60:11605:x1876350857211008:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789427923.293683:0:8694:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789427923.293804:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+60:11605:x1876350857211008:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 155us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.293811:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 214 00000100:00100000:0.0:1789427923.301248:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.301651:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857211136 00000100:00100000:3.0:1789427923.301666:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857211136 00000100:00100000:3.0:1789427923.301747:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 215 00000100:00100000:3.0:1789427923.301780:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+60:11605:x1876350857211136:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789427923.302103:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302123:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302137:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302155:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302161:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302167:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302216:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302224:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302231:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789427923.302275:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789427923.302279:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789427923.302293:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302315:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302322:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302330:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302336:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427923.302341:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302349:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302373:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:3.0:1789427923.302376:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427923.302382:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302388:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca3441c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302402:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302408:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302414:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302426:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427923.302429:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302435:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302443:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff933410b41400) 00010000:00010000:3.0:1789427923.302445:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427923.302448:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302454:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030e00/0x2bea1a57ca3441ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302471:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302477:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302483:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302489:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427923.302492:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302498:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.302517:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427923.302520:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427923.302524:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.305482:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca3441d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.305644:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+60:11605:x1876350857211136:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 Request processed in 3862us (4402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.305653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 215 00000100:00100000:1.0:1789427923.313312:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.313501:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857211392 00000100:00100000:2.0:1789427923.313511:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857211392 00000100:00100000:2.0:1789427923.313575:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 216 00000100:00100000:2.0:1789427923.313585:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+60:11605:x1876350857211392:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427923.313606:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427923.313631:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3441d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a6e expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.313732:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.313747:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.313773:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427923.313785:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789427923.313903:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.313910:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.313917:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.313922:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401491c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427923.313926:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.313933:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.313944:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:2.0:1789427923.313947:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789427923.313953:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.313959:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.314000:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3441d8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a6e expref: 62 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.314022:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:2.0:1789427923.314024:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427923.314028:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3441d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a6e expref: 62 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.314038:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a400, rc 0) 00000100:00100000:2.0:1789427923.314112:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341de75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+61:11605:x1876350857211392:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 527us (810us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789427923.314119:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 216 00000100:00100000:0.0:1789427923.318904:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.318984:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857211520 00000100:00100000:2.0:1789427923.318997:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857211520 00000100:00100000:2.0:1789427923.319060:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 217 00000100:00100000:2.0:1789427923.319072:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933410062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+61:11605:x1876350857211520:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789427923.319109:0:5835:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789427923.319249:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933410062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+61:11605:x1876350857211520:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 178us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.319257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 217 00000100:00100000:1.0:1789427923.342367:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.343129:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857211776 00000100:00100000:2.0:1789427923.343141:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857211776 00000100:00100000:2.0:1789427923.343230:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 218 00000100:00100000:2.0:1789427923.343242:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+61:11605:x1876350857211776:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427923.343267:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427923.343270:0:8694:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789427923.343302:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491600/0x2bea1a57ca34417d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a52 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.343342:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:2.0:1789427923.343347:0:8694:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427923.343372:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a75 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789427923.343791:0:8694:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789427923.344492:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3441f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.344509:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3441f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.344523:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3441f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.344586:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401491c00/0x2bea1a57ca3441ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a75 expref: 63 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.344604:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3441f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a75 expref: 62 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.344612:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8a00) 00010000:00010000:2.0:1789427923.344615:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789427923.344618:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e02a400, rc 0) 00000100:00100000:2.0:1789427923.344696:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+62:11605:x1876350857211776:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 1456us (2352us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789427923.344705:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 218 00000100:00100000:1.0:1789427923.357222:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.357316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857212032 00000100:00100000:2.0:1789427923.357326:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857212032 00000100:00100000:2.0:1789427923.357396:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 219 00000100:00100000:2.0:1789427923.357406:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+62:11605:x1876350857212032:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789427923.357480:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427923.357509:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02a400/0x2bea1a57ca3441f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a75 expref: 62 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357528:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8a00) 00010000:00010000:2.0:1789427923.357538:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427923.357584:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357600:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357610:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357624:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357630:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357636:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357711:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357731:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357737:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357743:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d5400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427923.357748:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357756:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357764:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:2.0:1789427923.357767:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427923.357772:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357778:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344202 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357788:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357793:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357798:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357802:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d5a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427923.357810:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357817:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357824:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3aaa46bd (ffff9334220b8f00) 00010000:00010000:2.0:1789427923.357827:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427923.357830:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.357835:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344209 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3aaa46bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427923.358131:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+61:11605:x1876350857212032:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 724us (917us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789427923.358139:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 219 00000100:00100000:0.0:1789427923.375281:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.383699:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857212160 00000100:00100000:2.0:1789427923.383723:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857212160 00000100:00100000:2.0:1789427923.383813:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 220 00000100:00100000:2.0:1789427923.383825:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+61:11605:x1876350857212160:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427923.384639:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427923.384682:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344210 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.384726:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.384743:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.384780:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.385120:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a7c expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.385142:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a7c expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.385151:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:2.0:1789427923.385154:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789427923.385158:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5400, rc 0) 00000100:00100000:2.0:1789427923.385425:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+62:11605:x1876350857212160:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 1602us (10153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.385434:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 220 00000100:00100000:1.0:1789427923.394429:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.399620:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857212416 00000100:00100000:2.0:1789427923.399638:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857212416 00000100:00100000:3.0:1789427923.403895:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 221 00000100:00100000:3.0:1789427923.403929:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+62:11605:x1876350857212416:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789427923.404984:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.405089:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.405106:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427923.405418:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1789427923.405428:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378340252301ns, next at 379340249969ns, rc = 0 00000004:00010000:3.0:1789427923.405515:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a4b641f3 reply state 0000000075ea62d3 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.405526:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789427923.405646:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+64:11605:x1876350857212416:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 1723us (11225us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789427923.407155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 221 00000100:00100000:1.0:1789427923.427116:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00010000:00010000:3.0:1789427923.428226:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.428242:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.428250:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.428257:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427923.428263:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.428272:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.428290:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:3.0:1789427923.428293:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789427923.428298:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.428304:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030800/0x2bea1a57ca34421e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427923.431148:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857212544 00000100:00100000:2.0:1789427923.431164:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857212544 00000100:00100000:2.0:1789427923.431273:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 222 00000100:00100000:2.0:1789427923.431285:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+63:11605:x1876350857212544:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427923.431310:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427923.431332:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a83 expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.431411:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a83 expref: 64 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.431444:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a83 expref: 64 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.431467:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:2.0:1789427923.431471:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789427923.431475:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5a00, rc 0) 00000100:00100000:2.0:1789427923.431553:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+64:11605:x1876350857212544:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 270us (4447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.431560:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 222 00000100:00100000:0.0:1789427923.441939:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427923.442141:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857212672 00000100:00100000:1.0:1789427923.442152:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857212672 00000100:00100000:1.0:1789427923.442274:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 62 00000100:00100000:1.0:1789427923.442299:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+9:2355:x1876350857212672:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789427923.442605:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+10:2355:x1876350857212672:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 308us (678us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789427923.442613:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 62 00000100:00080000:0.0:1789427923.443038:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427923.453569:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.455274:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857212928 00000100:00100000:2.0:1789427923.455289:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857212928 00000100:00100000:2.0:1789427923.455407:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 60 00000100:00100000:2.0:1789427923.455424:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+64:11605:x1876350857212928:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789427923.455701:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+65:11605:x1876350857212928:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 284us (2141us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789427923.455710:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 60 00000100:00100000:2.0:1789427923.463958:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.464067:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857213184 00000100:00100000:3.0:1789427923.464081:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857213184 00000100:00100000:3.0:1789427923.464155:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 223 00000100:00100000:3.0:1789427923.464169:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+65:11605:x1876350857213184:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789427923.464390:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+65:11605:x1876350857213184:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 224us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.464398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 223 00000100:00100000:0.0:1789427923.471383:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.471664:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857213312 00000100:00100000:2.0:1789427923.471677:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857213312 00000100:00100000:2.0:1789427923.471744:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 224 00000100:00100000:2.0:1789427923.471755:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+65:11605:x1876350857213312:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789427923.471778:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427923.471799:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5200/0x2bea1a57ca34422c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a8a expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.471896:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.471923:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.471938:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427923.471986:0:8694:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427923.472008:0:8694:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.472039:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5200/0x2bea1a57ca34422c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a8a expref: 67 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.472062:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a8a expref: 66 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.472072:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:2.0:1789427923.472075:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789427923.472079:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5000, rc 0) 00000100:00100000:2.0:1789427923.472167:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+66:11605:x1876350857213312:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 413us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.472236:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 224 00000100:00100000:1.0:1789427923.477281:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.477382:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857213440 00000100:00100000:3.0:1789427923.477395:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857213440 00000100:00100000:3.0:1789427923.477450:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 63 00000100:00100000:3.0:1789427923.477461:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+10:2354:x1876350857213440:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789427923.477482:0:8466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427923.477506:0:8466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a91 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427923.477538:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa880d3, blocks: 0x1 00010000:00010000:3.0:1789427923.477566:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1789427923.477570:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427923.477581:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a91 expref: 11 pid: 8466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.477603:0:8466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a91 expref: 11 pid: 8466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.477618:0:8466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789427923.477684:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+11:2354:x1876350857213440:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 226us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.477691:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 63 00000100:00100000:1.0:1789427923.487280:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.487423:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857213696 00000100:00100000:3.0:1789427923.487452:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857213696 00000100:00100000:3.0:1789427923.487517:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 225 00000100:00100000:3.0:1789427923.487527:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+66:11605:x1876350857213696:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789427923.487653:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+66:11605:x1876350857213696:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 127us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.487660:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 225 00000100:00100000:0.0:1789427923.494676:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427923.494786:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857213824 00000100:00100000:1.0:1789427923.494797:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857213824 00000100:00100000:1.0:1789427923.494871:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 64 00000100:00100000:1.0:1789427923.494882:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+11:11605:x1876350857213824:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789427923.494904:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427923.494939:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a98 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.494976:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a91 expref: 12 pid: 8466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.494986:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427923.494991:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427923.494997:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 12 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.495032:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a91 expref: 12 pid: 8466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.495067:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a91 expref: 12 pid: 8466 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427923.495083:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933301ac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876350877120896:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789427923.495229:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427923.503486:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.503787:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857213952 00000100:00100000:2.0:1789427923.503797:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857213952 00010000:00010000:2.0:1789427923.503859:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a91 expref: 13 pid: 8466 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427923.503922:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 80 00000100:00100000:2.0:1789427923.503933:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+13:2356:x1876350857213952:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427923.503954:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427923.503980:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a91 expref: 13 pid: 8466 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.503993:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a91 expref: 13 pid: 8466 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.504023:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427923.504028:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427923.504037:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.504048:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.504091:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427923.504110:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5822:1876350877121024:192.168.201.55@tcp:105: 00000100:00100000:2.0:1789427923.504248:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062f480 going to sleep for 11 seconds 00010000:00010000:0.0:1789427923.504421:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1d0436/0x2bea1a57ca34423a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a91 expref: 13 pid: 8466 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.504440:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933301ac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876350877120896:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427923.504472:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 12 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.504484:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700600, rc 0) 00000100:00100000:0.0:1789427923.504516:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+12:11605:x1876350857213824:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 9636us (9851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427923.504525:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 64 00000100:00100000:0.0:1789427923.508929:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5822:1876350877121024:192.168.201.55@tcp:105: 00010000:00010000:0.0:1789427923.508965:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427923.509029:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+11:2356:x1876350857213952:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 5097us (5556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427923.509040:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 80 00000100:00100000:1.0:1789427923.512869:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.512978:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857214080 00000100:00100000:2.0:1789427923.513005:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857214080 00002000:00100000:2.0:1789427923.513056:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff93341e215f80 x1876350857214080/t0(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:169/0 lens 504/0 e 0 to 0 dl 1789427934 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427923.513067:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93341e215f80 with x1876350857214080 ext(0->12) 00002000:00010000:2.0:1789427923.513073:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93341e215f80 00000100:00100000:2.0:1789427923.513108:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:2.0:1789427923.513117:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:691432fe-93d9-4afe-b1ac-013e2024784c+11:2357:x1876350857214080:12345-192.168.201.55@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789427923.513654:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:691432fe-93d9-4afe-b1ac-013e2024784c+13:2357:x1876350857214080:12345-192.168.201.55@tcp:4:lhsmtool_posix.0 Request processed in 535us (808us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789427923.513664:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 6 00002000:00100000:2.0:1789427923.513672:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff93341e215f80 x1876350857214080/t4294967320(0) o4->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:169/0 lens 504/448 e 0 to 0 dl 1789427934 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789427923.513681:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93341e215f80 with x1876350857214080 ext(0->12) 00002000:00010000:2.0:1789427923.513686:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93341e215f80 00000100:00100000:1.0:1789427923.519267:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.519685:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857214208 00000100:00100000:2.0:1789427923.519695:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857214208 00000100:00100000:2.0:1789427923.519749:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 226 00000100:00100000:2.0:1789427923.519758:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+66:11605:x1876350857214208:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789427923.617447:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00000004:00080000:3.0:1789427923.617476:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789427923.617501:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff933420e9a6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789427923.617506:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e1aae00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff933420e9a240 00000020:00080000:3.0:1789427923.617510:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93341e1aa900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93341e81b400 00000001:00080000:3.0:1789427923.617549:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1789427923.617569:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1789427923.617587:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:3.0:1789427923.617609:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93341d81bf00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789427923.617612:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93343b614700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93341d81b900 00000020:00080000:3.0:1789427923.617614:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93343b614600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93341dd0dc00 00000020:00080000:3.0:1789427923.617628:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789427923.617640:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789427923.617834:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789427923.617986:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877121152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789427923.618052:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.618108:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427923.618114:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877121280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789427923.618136:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.618719:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877121152 00000100:00100000:3.0:1789427923.618729:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877121152 00000100:00100000:3.0:1789427923.618782:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877121280 00000100:00100000:3.0:1789427923.618785:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877121280 00000100:00100000:3.0:1789427923.618806:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789427923.618815:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1876350877121152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789427923.618841:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1789427923.618878:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.618900:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f7 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.618909:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789427923.618913:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427923.618917:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.618945:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f7 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.618959:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f7 expref: 12 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.618972:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8466:1876350877121408:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427923.619038:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789427923.619054:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789427923.619071:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1876350877121280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789427923.619601:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789427923.619607:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789427923 00002000:00010000:3.0:1789427923.619609:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789427923.619611:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789427923 -> 1789427923 00002000:00010000:3.0:1789427923.619614:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789427923.619661:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3300:x1876350877121280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 590us (1523us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789427923.619668:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1789427923.619716:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93343aca3800/2, rc 0, transno 4294967321 00000100:00100000:3.0:1789427923.619723:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877121280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789427923.620364:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877121536:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789427923.620407:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427923.620537:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877121536 00000100:00100000:1.0:1789427923.620545:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877121536 00000100:00100000:1.0:1789427923.620592:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789427923.620602:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1876350877121536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789427923.620621:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1789427923.620649:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa880d1, atime: 0x6aa880d2, ctime: 0x6aa880d1, blocks: 0x1 00010000:00010000:1.0:1789427923.620656:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.620672:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1789427923.620676:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789427923.620684:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.620703:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.620733:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.620741:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.620757:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789427923.621389:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789427923.621394:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789427923.621630:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3298:x1876350877121536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1029us (1222us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789427923.621639:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1789427923.621716:0:7625:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427923.621723:0:7625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.621733:0:7625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789427923.621738:0:7625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.621746:0:7625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.621763:0:7625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.621783:0:7625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007596ca02/0x2bea1a57ca34424f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.621803:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427923.621805:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427923.621807:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789427923.621882:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93341e215500/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789427923.621894:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877121536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789427923.622091:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+20:11605:x1876350857214208:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 Request processed in 102331us (102835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.622099:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 226 00000100:00100000:1.0:1789427923.624163:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427923.624407:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857214336 00000100:00100000:0.0:1789427923.624418:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857214336 00010000:00010000:0.0:1789427923.624468:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f7 expref: 13 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.624521:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 81 00000100:00100000:0.0:1789427923.624532:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+13:2356:x1876350857214336:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427923.624549:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427923.624554:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f7 expref: 13 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.624569:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f7 expref: 13 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.624597:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427923.624602:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789427923.624608:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.624618:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.624638:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789427923.624792:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+13:2356:x1876350857214336:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 261us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427923.624821:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 81 00010000:00010000:3.0:1789427923.625638:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031e8ba85/0x2bea1a57ca34400a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.55@tcp remote: 0x954cd080504a89f7 expref: 12 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.625659:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8466:1876350877121408:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427923.625683:0:8466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.625694:0:8466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.625701:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.625710:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.625718:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.625757:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789427923.626505:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3300:x1876350877121152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7688us (8450us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789427923.626515:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1789427923.626953:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93343aca1500/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789427923.626961:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877121152:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789427923.627038:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427923.627046:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.627058:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789427923.627063:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.627073:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.627091:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.627099:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a08b94/0x2bea1a57ca344248 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.627120:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427923.627122:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427923.627124:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427923.627520:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.627934:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857214464 00000100:00100000:3.0:1789427923.627943:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857214464 00000100:00100000:3.0:1789427923.628025:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 68 00000100:00100000:3.0:1789427923.628035:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+12:2357:x1876350857214464:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789427923.668040:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1789427923.668058:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1789427923.668064:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1789427923.668078:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1789427923.668538:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857214464:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 Request processed in 40497us (41013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.668552:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 68 00000100:00100000:1.0:1789427923.674536:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.675018:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857214720 00000100:00100000:3.0:1789427923.675030:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857214720 00000100:00100000:3.0:1789427923.675091:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 227 00000100:00100000:3.0:1789427923.675101:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+20:11605:x1876350857214720:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789427923.675156:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427923.675212:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a8a expref: 20 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.675234:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:3.0:1789427923.675240:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789427923.675273:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.675298:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.675307:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789427923.675651:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e4f5a986 reply state 00000000eb63590b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427923.675663:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789427923.675813:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:11605:x1876350857214720:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 712us (1288us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789427923.675821:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 227 00000100:00100000:1.0:1789427923.682615:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.682897:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857214848 00000100:00100000:3.0:1789427923.682908:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857214848 00010000:00010000:2.0:1789427923.682929:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.682945:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.682954:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.682962:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427923.682968:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.682975:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 69 00010000:00010000:2.0:1789427923.682979:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.682989:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857214848:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00010000:00010000:2.0:1789427923.682999:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:2.0:1789427923.683004:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789427923.683010:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.683017:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030600/0x2bea1a57ca344256 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789427923.683294:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789427923.683298:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789427923 -> 1789427922 00002000:00010000:3.0:1789427923.683301:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789427922 00002000:00010000:3.0:1789427923.683303:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789427923 -> 1789427922 00002000:00010000:3.0:1789427923.683305:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789427923.683375:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+8:2357:x1876350857214848:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 389us (768us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789427923.683382:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 69 00000100:00100000:1.0:1789427923.688274:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427923.689100:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857215104 00000100:00100000:0.0:1789427923.689114:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857215104 00000100:00100000:0.0:1789427923.689210:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 228 00000100:00100000:0.0:1789427923.689222:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+20:11605:x1876350857215104:12345-192.168.201.55@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789427923.689297:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.689329:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a7c expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.689338:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.689384:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a7c expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.689398:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a7c expref: 20 pid: 5836 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.689411:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877121664:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427923.689494:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410659d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427923.694270:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.694340:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857215232 00000100:00100000:3.0:1789427923.694358:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857215232 00010000:00010000:3.0:1789427923.694399:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a7c expref: 21 pid: 5836 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.694455:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 82 00000100:00100000:3.0:1789427923.694465:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:2356:x1876350857215232:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789427923.694481:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427923.694501:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a7c expref: 21 pid: 5836 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.694514:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a7c expref: 21 pid: 5836 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.694535:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:3.0:1789427923.694541:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.694550:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.694559:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.694576:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427923.694626:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:691432fe-93d9-4afe-b1ac-013e2024784c+21:2356:x1876350857215232:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 162us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.694634:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 82 00010000:00010000:0.0:1789427923.695123:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5400/0x2bea1a57ca344217 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a7c expref: 20 pid: 5836 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.695141:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1876350877121664:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427923.695160:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.695169:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.695217:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.695244:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.695259:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.695267:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.695274:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789427923.695278:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.695285:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.695295:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:0.0:1789427923.695297:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789427923.695301:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.695308:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34425d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.695359:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+19:11605:x1876350857215104:12345-192.168.201.55@tcp:55:lhsmtool_posix.0 Request processed in 6129us (7084us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789427923.695367:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 228 00000100:00100000:1.0:1789427923.700587:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.701283:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857215360 00000100:00100000:3.0:1789427923.701301:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857215360 00000100:00100000:3.0:1789427923.701389:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 70 00000100:00100000:3.0:1789427923.701400:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857215360:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789427923.701671:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.701698:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.701729:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789427923.701733:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789427923.701738:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.701772:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.701787:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 8 pid: 6684 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.701802:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876350877121792:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789427923.701937:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e1ad540 going to sleep for 11 seconds 00000100:00100000:3.0:1789427923.708096:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876350877121792:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789427923.708132:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427923.708414:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.708502:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857215488 00000100:00100000:2.0:1789427923.708523:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857215488 00010000:00010000:2.0:1789427923.708562:0:11166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 9 pid: 6684 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427923.708636:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 83 00000100:00100000:2.0:1789427923.708645:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+9:2356:x1876350857215488:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427923.708660:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427923.708682:0:11166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 9 pid: 6684 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.708695:0:11166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 9 pid: 6684 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.708718:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344241 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a98 expref: 9 pid: 6684 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.708736:0:11166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427923.708741:0:11166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789427923.708747:0:11166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.708756:0:11166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.708788:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427923.708855:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857215488:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 210us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.708872:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 83 00010000:00010000:3.0:1789427923.709617:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.709632:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.709659:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.709677:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.709686:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.709694:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789427923.709700:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.709710:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.709724:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.709732:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecbbbce9/0x2bea1a57ca344264 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.709813:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:2356:x1876350857215360:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 Request processed in 8413us (9234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427923.709822:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 70 00000100:00100000:1.0:1789427923.716272:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427923.716372:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857215744 00000100:00100000:0.0:1789427923.716385:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857215744 00000100:00100000:0.0:1789427923.716454:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 229 00000100:00100000:0.0:1789427923.716465:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+19:11605:x1876350857215744:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789427923.716557:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.716587:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.716609:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.716830:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.716845:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a83 expref: 20 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.716854:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.716901:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a83 expref: 20 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.716918:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a83 expref: 20 pid: 8694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.716937:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877121920:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427923.717046:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410659d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427923.728030:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.728127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857215872 00000100:00100000:2.0:1789427923.728138:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857215872 00010000:00010000:2.0:1789427923.728216:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a83 expref: 21 pid: 8694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427923.728260:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 84 00000100:00100000:2.0:1789427923.728271:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+21:2356:x1876350857215872:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427923.728288:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427923.728297:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a83 expref: 21 pid: 8694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.728311:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a83 expref: 21 pid: 8694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.728334:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:2.0:1789427923.728340:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.728415:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.728424:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427923.728445:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427923.728493:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+21:2356:x1876350857215872:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 225us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.728518:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 84 00010000:00010000:0.0:1789427923.728669:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5a00/0x2bea1a57ca344225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a83 expref: 20 pid: 8694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.728687:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877121920:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427923.728708:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.728723:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.728730:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789427923.728916:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1789427923.729065:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789427923.729109:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1789427923.729240:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1876350877122048:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789427923.729293:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427923.729318:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789427923.732824:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877122048 00000100:00100000:2.0:1789427923.732843:0:11961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877122048 00000100:00100000:2.0:1789427923.732919:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789427923.732931:0:11961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5835:x1876350877122048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789427923.733080:0:11961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5835:x1876350877122048:12345-0@lo:1000:mdt00_001.0 Request processed in 151us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.733088:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789427923.733247:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789427923.733254:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1789427923.733274:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93343aca3800, transno 4294967321 00000004:00080000:3.0:1789427923.733309:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93343aca1500, transno 4294967322 00000100:00100000:3.0:1789427923.733318:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1876350877122048:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789427923.733880:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789427923.733977:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1876350877122176:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789427923.734026:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427923.734069:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e1ade40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427923.734159:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877122176 00000100:00100000:1.0:1789427923.734165:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877122176 00000100:00100000:1.0:1789427923.734230:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789427923.734238:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1876350877122176:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789427923.734437:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1876350877122176:12345-0@lo:1000:mdt00_001.0 Request processed in 199us (410us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789427923.734453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789427923.734547:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1876350877122176:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789427923.734582:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734594:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734603:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734609:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427923.734614:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734623:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734641:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:3.0:1789427923.734645:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427923.734650:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734656:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178a00/0x2bea1a57ca344272 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734700:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734708:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734713:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734719:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02be00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427923.734721:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734728:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734736:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427923.734738:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789427923.734746:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3441bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a67 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734759:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3441bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a67 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734769:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3441bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a67 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.734797:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3441bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a67 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.734823:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877122304:192.168.201.55@tcp:105: 00000100:00100000:3.0:1789427923.734906:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e1ade40 going to sleep for 11 seconds 00000100:00100000:3.0:1789427923.741467:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1876350877122304:192.168.201.55@tcp:105: 00010000:00010000:3.0:1789427923.741498:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741510:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02be00/0x2bea1a57ca3441b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741556:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741571:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741584:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741595:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741602:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741609:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741614:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427923.741618:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741639:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741650:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427923.741653:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789427923.741657:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741662:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030200/0x2bea1a57ca344279 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741672:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741678:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741684:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741689:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789427923.741692:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741697:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741704:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:3.0:1789427923.741706:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789427923.741708:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.741722:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178c00/0x2bea1a57ca34426b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.741991:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+23:11605:x1876350857215744:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 25526us (25726us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789427923.742002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 229 00000020:00080000:3.0:1789427923.742007:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789427923.742068:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427923.742073:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427923.742803:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789427923.742813:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789427923.743821:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427923.744033:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857216000 00000100:00100000:2.0:1789427923.744045:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857216000 00000100:00100000:2.0:1789427923.744095:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 61 00000100:00100000:2.0:1789427923.744103:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+23:11604:x1876350857216000:12345-192.168.201.55@tcp:49:lfs.0 00000100:00100000:2.0:1789427923.744358:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+23:11604:x1876350857216000:12345-192.168.201.55@tcp:49:lfs.0 Request processed in 246us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.744366:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 61 00000100:00100000:2.0:1789427923.748848:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.749041:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857216256 00000100:00100000:3.0:1789427923.749053:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857216256 00000100:00100000:3.0:1789427923.749121:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 62 00000100:00100000:3.0:1789427923.749132:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419a97c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+23:11605:x1876350857216256:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789427923.750049:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789427923.750395:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1789427923.750441:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.750457:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.750468:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.750478:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.750489:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.750495:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427923.750585:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789427923.750786:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427923.750794:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.750802:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789427923.750806:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.750816:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427923.750821:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419a97c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+25:11605:x1876350857216256:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 1686us (1987us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789427923.750835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 62 00000020:00080000:3.0:1789427923.750841:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789427923.750846:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff933410b41400) 00010000:00010000:1.0:1789427923.750851:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789427923.750856:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.750863:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031800/0x2bea1a57ca344280 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.750883:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427923.750885:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427923.750887:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427923.753026:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427923.753117:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857216512 00000100:00100000:1.0:1789427923.753129:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857216512 00000100:00100000:1.0:1789427923.753216:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 230 00000100:00100000:1.0:1789427923.753227:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+25:11604:x1876350857216512:12345-192.168.201.55@tcp:58:lfs.0 00000040:00080000:1.0:1789427923.753521:0:8694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789427923.753603:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+25:11604:x1876350857216512:12345-192.168.201.55@tcp:58:lfs.0 Request processed in 377us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427923.753626:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 230 00000100:00100000:2.0:1789427923.802077:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427923.802214:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857216640 00000100:00100000:0.0:1789427923.802226:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857216640 00000100:00100000:0.0:1789427923.802288:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 231 00000100:00100000:0.0:1789427923.802299:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+25:11607:x1876350857216640:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427923.802330:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427923.802364:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344287 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8a9f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.802440:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.802458:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.802471:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.802511:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.802519:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.802727:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.802969:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.802981:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a60 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.802989:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.803029:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a60 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.803044:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a60 expref: 26 pid: 5835 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.803059:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877122432:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789427923.804222:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333013bcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789427923.818489:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1876350877122432:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789427923.818781:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427923.819730:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427923.819959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857216896 00000100:00100000:3.0:1789427923.819970:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857216896 00000100:00100000:3.0:1789427923.820037:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 63 00000100:00100000:3.0:1789427923.820049:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+27:5592:x1876350857216896:12345-192.168.201.55@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789427923.822032:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+28:5592:x1876350857216896:12345-192.168.201.55@tcp:35:ldlm_bl.0 Request processed in 1972us (2296us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789427923.822045:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 63 00000100:00100000:2.0:1789427923.831052:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427923.831157:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857217024 00000100:00100000:0.0:1789427923.831168:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857217024 00010000:00010000:0.0:1789427923.831264:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a60 expref: 28 pid: 5835 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427923.831306:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 85 00000100:00100000:0.0:1789427923.831316:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+28:2356:x1876350857217024:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789427923.831334:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789427923.831341:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a60 expref: 28 pid: 5835 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.831365:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a60 expref: 28 pid: 5835 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.831387:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490a00/0x2bea1a57ca3441a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a60 expref: 28 pid: 5835 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.831405:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427923.831411:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.831421:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.831429:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427923.831456:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789427923.831685:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831694:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789427923.831741:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789427923.831745:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789427923.831766:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831781:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831790:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831797:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831803:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831808:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427923.831812:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831820:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831829:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:1.0:1789427923.831839:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427923.831856:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831863:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca34428e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831877:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831883:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831888:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831893:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427923.831895:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831900:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831906:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9334083ca500) 00010000:00010000:1.0:1789427923.831909:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789427923.831912:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831917:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca344295 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831950:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179c00/0x2bea1a57ca344287 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a9f expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831975:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a9f expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427923.831982:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:1.0:1789427923.831984:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789427923.831987:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179800, rc 0) 00000100:00100000:0.0:1789427923.832067:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:691432fe-93d9-4afe-b1ac-013e2024784c+27:2356:x1876350857217024:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 752us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427923.832077:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 85 00000100:00100000:1.0:1789427923.832847:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+26:11607:x1876350857216640:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 30546us (30781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427923.832856:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 231 00000100:00100000:1.0:1789427923.914274:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427923.914301:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877122560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789427923.914383:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427923.914721:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877122560 00000100:00100000:2.0:1789427923.914731:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877122560 00000100:00100000:2.0:1789427923.914807:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789427923.914817:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877122560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427923.914842:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789427923.914900:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877122560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427923.914908:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789427923.915078:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877122560:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789427924.006945:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789427924.006967:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:0.0:1789427924.169834:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789427924.746429:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789427924.746440:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427924.746474:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789427924.746479:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789427924.746604:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877122688:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789427924.746693:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427924.754516:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427924.754748:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857217152 00000100:00100000:0.0:1789427924.754761:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857217152 00000100:00100000:0.0:1789427924.754844:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 232 00000100:00100000:0.0:1789427924.754858:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+27:11618:x1876350857217152:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789427924.754906:0:8694:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789427924.755016:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+27:11618:x1876350857217152:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 162us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427924.755023:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 232 00000100:00080000:0.0:1789427924.755046:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427924.759423:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1876350877122688:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789427924.768052:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427924.768218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857217408 00000100:00100000:0.0:1789427924.768229:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857217408 00000100:00100000:0.0:1789427924.768376:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 233 00000100:00100000:0.0:1789427924.768388:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+26:11618:x1876350857217408:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789427924.768411:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427924.768434:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3442a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8aa6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427924.768534:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca3442aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427924.768550:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca3442aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427924.768563:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca3442aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427924.768589:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789427924.768713:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179600/0x2bea1a57ca3442a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8aa6 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427924.768729:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca3442aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8aa6 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427924.768738:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427924.768740:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427924.768744:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179e00, rc 0) 00000100:00100000:0.0:1789427924.768803:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:691432fe-93d9-4afe-b1ac-013e2024784c+28:11618:x1876350857217408:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 416us (760us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789427924.768810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 233 00000100:00100000:0.0:1789427924.779643:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427924.779779:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857217536 00000100:00100000:2.0:1789427924.779792:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857217536 00000100:00100000:2.0:1789427924.779887:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 18 00000100:00100000:2.0:1789427924.779900:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+28:2354:x1876350857217536:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427924.779924:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427924.779954:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179e00/0x2bea1a57ca3442aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8aa6 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427924.779975:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:2.0:1789427924.779981:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427924.780061:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:691432fe-93d9-4afe-b1ac-013e2024784c+27:2354:x1876350857217536:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 164us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427924.780070:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 18 00000100:00100000:0.0:1789427924.787022:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427924.787116:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857217792 00000100:00100000:1.0:1789427924.787128:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857217792 00000100:00100000:1.0:1789427924.787220:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 234 00000100:00100000:1.0:1789427924.787232:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+27:11618:x1876350857217792:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789427924.787324:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427924.787355:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427924.787368:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427924.787618:0:8694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427924.787649:0:8694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427924.787656:0:8694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427924.787662:0:8694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789427924.787666:0:8694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427924.787673:0:8694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427924.787688:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:1.0:1789427924.787690:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789427924.787696:0:8694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427924.787701:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3442b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427924.788046:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+28:11618:x1876350857217792:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 814us (1031us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789427924.788055:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 234 00000040:00080000:3.0:1789427924.788453:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427924.788461:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427924.788982:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789427924.789002:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789427924.797942:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427924.801596:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857218048 00000100:00100000:3.0:1789427924.801614:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857218048 00000100:00100000:3.0:1789427924.802636:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 64 00000100:00100000:3.0:1789427924.802657:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+28:11618:x1876350857218048:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789427924.802963:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+29:11618:x1876350857218048:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 310us (5030us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789427924.802972:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 64 00000040:00080000:1.0:1789427924.816354:0:12567:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789427924.816365:0:12567:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789427924.816416:0:12567:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789427924.816422:0:12567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427924.937480:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877122816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427924.937575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427924.937903:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877122816 00000100:00100000:2.0:1789427924.937921:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877122816 00000100:00100000:2.0:1789427924.937985:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789427924.937995:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877122816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789427924.938030:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427924.938094:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877122816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427924.938101:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789427924.938171:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789427924.938218:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93343b1b1500, transno 4294967307 00000004:00080000:3.0:1789427924.938234:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1789427924.938258:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93341e215500, transno 4294967310 00000100:00100000:3.0:1789427924.938272:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877122816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789427924.939505:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877123072:0@lo:400:kworker.0 00000100:00100000:0.0:1789427924.939579:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427924.939618:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789427924.939623:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877123200:0@lo:400:kworker.0 00000100:00100000:0.0:1789427924.939645:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427924.939676:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877123072 00000100:00100000:0.0:1789427924.939682:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877123072 00000100:00100000:0.0:1789427924.939725:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877123200 00000100:00100000:0.0:1789427924.939728:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877123200 00000100:00100000:0.0:1789427924.939754:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789427924.939769:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877123072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427924.939816:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877123072:12345-0@lo:400:kworker.0 Request processed in 47us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427924.939823:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789427924.939840:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789427924.939847:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877123200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427924.939873:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877123200:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427924.939878:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1789427924.939900:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427924.939930:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877123200:0@lo:400:kworker.0 00000100:00100000:0.0:1789427924.939940:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877123072:0@lo:400:kworker.0 00000100:00100000:3.0:1789427924.940012:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877123328:0@lo:400:kworker.0 00000100:00100000:3.0:1789427924.940044:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427924.940074:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789427924.940080:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877122944:0@lo:400:kworker.0 00000100:00100000:3.0:1789427924.940108:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427924.940134:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877123456:0@lo:400:kworker.0 00000100:00100000:3.0:1789427924.940155:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427924.940200:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877122944 00000100:00100000:3.0:1789427924.940205:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877122944 00000100:00100000:3.0:1789427924.940236:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789427924.940242:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877122944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427924.940277:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3300:x1876350877122944:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427924.940284:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789427924.940342:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877122944:0@lo:400:kworker.0 00000100:00100000:0.0:1789427924.940405:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877123328 00000100:00100000:0.0:1789427924.940410:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877123328 00000100:00100000:0.0:1789427924.940443:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789427924.940450:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1876350877123328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427924.940487:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1876350877123328:12345-0@lo:400:kworker.0 Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427924.940493:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789427924.940508:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877123456 00000100:00100000:0.0:1789427924.940512:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877123456 00000100:00100000:0.0:1789427924.940536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789427924.940542:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877123456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789427924.940573:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877123456:12345-0@lo:400:kworker.0 Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427924.940589:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1789427924.940607:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789427924.940626:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877123456:0@lo:400:kworker.0 00000100:00100000:0.0:1789427924.940635:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877123328:0@lo:400:kworker.0 00000100:00100000:3.0:1789427925.008410:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427925.008503:0:8694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857218304 00000100:00100000:0.0:1789427925.008515:0:8694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857218304 00000100:00100000:0.0:1789427925.008597:0:8694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 235 00000100:00100000:0.0:1789427925.008609:0:8694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+29:11631:x1876350857218304:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789427925.008637:0:8694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427925.008660:0:8694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca3442bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8aad expref: -99 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.008769:0:8694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3442c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.008786:0:8694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3442c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.008799:0:8694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3442c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8694 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789427925.008810:0:8694:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789427925.008942:0:8694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e178600/0x2bea1a57ca3442bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8aad expref: 32 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.008961:0:8694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3442c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8aad expref: 31 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427925.008987:0:8694:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427925.008990:0:8694:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789427925.008995:0:8694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179200, rc 0) 00000100:00100000:0.0:1789427925.009278:0:8694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:691432fe-93d9-4afe-b1ac-013e2024784c+31:11631:x1876350857218304:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 669us (879us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789427925.009286:0:8694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 235 00000100:00100000:2.0:1789427925.018749:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427925.018790:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857218432 00000100:00100000:2.0:1789427925.018802:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857218432 00000100:00100000:2.0:1789427925.018857:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 236 00000100:00100000:2.0:1789427925.018868:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+31:11631:x1876350857218432:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:2.0:1789427925.018943:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.018963:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.018977:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.019005:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.019012:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.019019:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.019025:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d4600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789427925.019119:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.019128:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.019140:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:2.0:1789427925.019143:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789427925.019148:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.019154:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3442d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427925.019252:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+31:11631:x1876350857218432:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 384us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427925.019260:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 236 00000100:00100000:3.0:1789427925.122304:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427925.122482:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857218560 00000100:00100000:2.0:1789427925.122494:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857218560 00000100:00100000:2.0:1789427925.122564:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 71 00000100:00100000:2.0:1789427925.122576:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+7:2355:x1876350857218560:12345-192.168.201.55@tcp:101:cat.0 00010000:00010000:2.0:1789427925.122607:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427925.122629:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3442db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8ab4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789427925.122659:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa880d2, atime: 0x6aa880d2, ctime: 0x6aa880d2, blocks: 0xb 00010000:00010000:2.0:1789427925.122683:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789427925.122688:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789427925.122697:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3442db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ab4 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.122735:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3442db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ab4 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427925.122748:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4600, rc 0) 00000100:00080000:0.0:1789427925.122907:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427925.123005:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2355:x1876350857218560:12345-192.168.201.55@tcp:101:cat.0 Request processed in 431us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427925.123013:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 71 00000100:00100000:2.0:1789427925.126806:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427925.130799:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857218688 00000100:00100000:0.0:1789427925.130951:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857218688 00002000:00100000:0.0:1789427925.131026:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93344198d880 x1876350857218688/t0(0) o3->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:171/0 lens 488/0 e 0 to 0 dl 1789427936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789427925.131037:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93344198d880 with x1876350857218688 ext(0->4095) 00002000:00010000:0.0:1789427925.131044:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93344198d880 00000100:00100000:0.0:1789427925.131085:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:0.0:1789427925.131096:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857218688:12345-192.168.201.55@tcp:3:cat.0 00000100:00100000:0.0:1789427925.131340:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857218688:12345-192.168.201.55@tcp:3:cat.0 Request processed in 246us (4543us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789427925.131348:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00002000:00100000:0.0:1789427925.131355:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93344198d880 x1876350857218688/t0(0) o3->691432fe-93d9-4afe-b1ac-013e2024784c@192.168.201.55@tcp:171/0 lens 488/4536 e 0 to 0 dl 1789427936 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789427925.131363:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93344198d880 with x1876350857218688 ext(0->4095) 00002000:00010000:0.0:1789427925.131367:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93344198d880 00010000:00010000:3.0:1789427925.193592:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427926.219834:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427927.005928:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427927.005970:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427927.006002:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427927.006003:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857218816 00000100:00100000:3.0:1789427927.006014:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857218816 00000100:00100000:2.0:1789427927.006023:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427927.006043:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427927.006063:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857219072 00000100:00100000:3.0:1789427927.006067:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 304 00000100:00100000:2.0:1789427927.006067:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857219072 00000100:00100000:3.0:1789427927.006077:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857218816:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427927.006107:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857219200 00000100:00100000:2.0:1789427927.006110:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857219200 00000100:00100000:2.0:1789427927.006131:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 85 00000100:00100000:2.0:1789427927.006138:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857219072:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427927.006165:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2356:x1876350857218816:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427927.006166:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+8:2356:x1876350857219072:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 30us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427927.006190:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 85 00000100:00100000:3.0:1789427927.006191:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 304 00000100:00100000:2.0:1789427927.006208:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 86 00000100:00100000:2.0:1789427927.006214:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857219200:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427927.006262:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:691432fe-93d9-4afe-b1ac-013e2024784c+5:2356:x1876350857219200:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 49us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427927.006269:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 86 00000100:00100000:2.0:1789427927.006299:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857219328 00000100:00100000:2.0:1789427927.006304:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857219328 00000100:00100000:2.0:1789427927.006331:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857218944 00000100:00100000:2.0:1789427927.006334:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857218944 00000100:00100000:2.0:1789427927.006352:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 173 00000100:00100000:2.0:1789427927.006373:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857219328:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427927.006401:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2356:x1876350857219328:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427927.006407:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 173 00000100:00100000:2.0:1789427927.006420:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 174 00000100:00100000:2.0:1789427927.006426:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+31:2356:x1876350857218944:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789427927.006452:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+31:2356:x1876350857218944:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427927.006457:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 174 00000100:00080000:2.0:1789427927.006478:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427927.006482:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789427927.006483:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789427927.245119:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427928.265375:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789427928.598793:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1789427928.598861:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93341e1add80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789427928.598867:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93343b614f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93341e1ad540 00000020:00080000:3.0:1789427928.598870:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93343b614d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93341deac800 00000020:00080000:3.0:1789427928.598887:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789427928.598995:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789427928.599337:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1789427929.034959:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427929.034984:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877123584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427929.035059:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427929.035223:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877123584 00000100:00100000:3.0:1789427929.035232:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877123584 00000100:00100000:3.0:1789427929.035303:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789427929.035312:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877123584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427929.035349:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789427929.035840:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789427929.043870:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877123584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8550us (8801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427929.043885:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789427929.044591:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877123584:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789427929.115705:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1789427929.115725:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:3.0:1789427929.289577:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427930.057600:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789427930.057630:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877123712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427930.057714:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427930.058031:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877123712 00000100:00100000:0.0:1789427930.058042:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877123712 00000100:00100000:0.0:1789427930.058118:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789427930.058130:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877123712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789427930.058204:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789427930.058277:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877123712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427930.058286:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789427930.058338:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877123712:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789427930.058430:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427930.061831:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427930.061856:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877123840:0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.061940:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427930.062013:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877123968:0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.062045:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427930.062078:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877123968 00000100:00100000:2.0:1789427930.062087:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877123968 00000100:00100000:2.0:1789427930.062139:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789427930.062149:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877123968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.062231:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877123968:12345-0@lo:400:kworker.0 Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427930.062250:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789427930.062293:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877123968:0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.062345:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877124096:0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.062370:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427930.062400:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877124096 00000100:00100000:2.0:1789427930.062404:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877124096 00000100:00100000:2.0:1789427930.062435:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789427930.062442:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877124096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.062479:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877124096:12345-0@lo:400:kworker.0 Request processed in 37us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427930.062485:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1789427930.062506:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789427930.062524:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877124096:0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.062555:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877124224:0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.064750:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427930.064851:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877124352:0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.064880:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427930.064916:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877124352 00000100:00100000:2.0:1789427930.064923:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877124352 00000100:00100000:2.0:1789427930.064974:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789427930.064984:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877124352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427930.065030:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343fac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877124352:12345-0@lo:400:kworker.0 Request processed in 47us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427930.065037:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789427930.065074:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877124352:0@lo:400:kworker.0 00000100:00080000:2.0:1789427930.065096:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427930.065197:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877123840 00000100:00100000:3.0:1789427930.065202:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877123840 00000100:00100000:3.0:1789427930.065230:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789427930.065248:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877123840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427930.065287:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877123840:12345-0@lo:400:kworker.0 Request processed in 51us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427930.065293:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789427930.065326:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877123840:0@lo:400:kworker.0 00000100:00100000:1.0:1789427930.065546:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877124224 00000100:00100000:1.0:1789427930.065552:0:8466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877124224 00000100:00100000:1.0:1789427930.065592:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789427930.065600:0:8466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877124224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427930.065655:0:8466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877124224:12345-0@lo:400:kworker.0 Request processed in 55us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427930.065662:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789427930.065731:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789427930.065738:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789427930.065757:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877124224:0@lo:400:kworker.0 00010000:00010000:1.0:1789427930.313323:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427930.606412:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427930.608556:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857219456 00000100:00100000:2.0:1789427930.608575:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857219456 00000100:00100000:2.0:1789427930.608755:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 237 00000100:00100000:2.0:1789427930.608776:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+18:11284:x1876350857219456:12345-192.168.201.55@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789427930.608911:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:691432fe-93d9-4afe-b1ac-013e2024784c+18:11284:x1876350857219456:12345-192.168.201.55@tcp:60:lhsmtool_posix.0 Request processed in 146us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427930.608918:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 237 00000100:00080000:0.0:1789427930.614350:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427930.619000:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427930.619160:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857219712 00000100:00100000:0.0:1789427930.619172:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857219712 00000100:00100000:0.0:1789427930.619270:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 65 00000100:00100000:0.0:1789427930.619279:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+18:11284:x1876350857219712:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789427930.619590:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+19:11284:x1876350857219712:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 311us (600us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789427930.619599:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 65 00010000:00010000:1.0:1789427931.339944:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427932.123457:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427932.123501:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427932.123545:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427932.123572:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427932.123602:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427932.123648:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857220352 00000100:00100000:1.0:1789427932.123663:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857220352 00000100:00100000:1.0:1789427932.123972:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857219968 00000100:00100000:1.0:1789427932.123977:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857219968 00000100:00100000:1.0:1789427932.124010:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 178 00000100:00100000:1.0:1789427932.124022:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857220352:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427932.124118:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2357:x1876350857220352:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 98us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427932.124125:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 178 00000100:00100000:1.0:1789427932.124145:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 179 00000100:00100000:1.0:1789427932.124151:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+19:2357:x1876350857219968:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427932.124222:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+19:2357:x1876350857219968:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 71us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427932.124254:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 179 00000100:00100000:1.0:1789427932.124283:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857220096 00000100:00100000:1.0:1789427932.124287:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857220096 00000100:00100000:1.0:1789427932.124317:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857220224 00000100:00100000:1.0:1789427932.124320:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857220224 00000100:00100000:1.0:1789427932.124344:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 88 00000100:00100000:1.0:1789427932.124351:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857220096:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427932.124631:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+7:2357:x1876350857220096:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 279us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427932.124639:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 88 00000100:00100000:1.0:1789427932.124652:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 89 00000100:00100000:1.0:1789427932.124659:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857220224:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427932.124686:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2357:x1876350857220224:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 27us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427932.124693:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 89 00000100:00080000:1.0:1789427932.124823:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427932.124828:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789427932.124831:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427932.134520:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857219840 00000100:00100000:3.0:1789427932.134548:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857219840 00000100:00100000:3.0:1789427932.135509:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 306 00000100:00100000:3.0:1789427932.135531:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857219840:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427932.136291:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2357:x1876350857219840:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 762us (12847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427932.136304:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 306 00010000:00010000:0.0:1789427932.361539:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789427932.648809:0:12768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:18:51 (1789427931) 00010000:00010000:3.0:1789427933.386327:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789427933.724584:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789427933.724609:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789427933.724632:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789427933.724644:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1789427934.025545:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427934.025558:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789427934.036480:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1789427934.036500:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789427934.153637:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877124480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789427934.153761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427934.153863:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877124480 00000100:00100000:3.0:1789427934.153874:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877124480 00000100:00100000:3.0:1789427934.153951:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789427934.153961:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877124480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789427934.154009:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427934.154072:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877124480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427934.154080:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1789427934.154108:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789427934.154141:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933411baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877124480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789427934.409865:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427935.187527:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877124736:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.187596:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877124608:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.187655:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427935.187656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427935.187710:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877125120:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.187753:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427935.187779:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789427935.187785:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933406140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877125248:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.187827:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427935.187857:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877124864:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.187886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427935.187905:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789427935.187910:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877124992:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.187934:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427935.187972:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877124608 00000100:00100000:2.0:1789427935.187982:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877124608 00000100:00100000:2.0:1789427935.188038:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789427935.188049:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877124608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.188108:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877124608:12345-0@lo:400:kworker.0 Request processed in 61us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427935.188115:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789427935.188165:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877125248 00000100:00100000:2.0:1789427935.188170:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877125248 00000100:00100000:2.0:1789427935.188238:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877124992 00000100:00100000:2.0:1789427935.188242:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877124992 00000100:00100000:2.0:1789427935.188262:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789427935.188269:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877125248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.188302:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877125248:12345-0@lo:400:kworker.0 Request processed in 34us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427935.188308:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789427935.188334:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789427935.188340:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877124992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.188384:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877124992:12345-0@lo:400:kworker.0 Request processed in 44us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427935.188391:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789427935.188413:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877124736 00000100:00100000:2.0:1789427935.188417:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877124736 00000100:00100000:2.0:1789427935.188442:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877125120 00000100:00100000:2.0:1789427935.188445:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877125120 00000100:00100000:2.0:1789427935.188460:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877124864 00000100:00100000:2.0:1789427935.188462:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877124864 00000100:00100000:2.0:1789427935.188479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789427935.188485:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877124736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.188517:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877124736:12345-0@lo:400:kworker.0 Request processed in 32us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427935.188523:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789427935.188534:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789427935.188539:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877125120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.188566:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877125120:12345-0@lo:400:kworker.0 Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427935.188571:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789427935.188581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789427935.188586:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933441bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877124864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.188612:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933441bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877124864:12345-0@lo:400:kworker.0 Request processed in 26us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427935.188617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789427935.188666:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933406140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877125248:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.188677:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877124608:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.188696:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877125120:0@lo:400:kworker.0 00000100:00080000:2.0:1789427935.188725:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789427935.188731:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789427935.188748:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877124992:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.188757:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877124864:0@lo:400:kworker.0 00000100:00100000:2.0:1789427935.189425:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877125376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789427935.189471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427935.189961:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877124736:0@lo:400:kworker.0 00000100:00100000:1.0:1789427935.196832:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877125376 00000100:00100000:1.0:1789427935.196855:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877125376 00000100:00100000:1.0:1789427935.196941:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789427935.196953:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877125376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789427935.197017:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789427935.197156:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877125376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 204us (7682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427935.197190:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789427935.197255:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877125376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789427935.413637:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427935.413829:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857220480 00000100:00100000:2.0:1789427935.413844:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857220480 00000100:00100000:2.0:1789427935.413937:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 238 00000100:00100000:2.0:1789427935.413949:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:12295:x1876350857220480:12345-192.168.201.55@tcp:101:lsof.0 00010000:00010000:2.0:1789427935.413977:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427935.414004:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4e00/0x2bea1a57ca3442e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8abb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427935.414087:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5c00/0x2bea1a57ca3442e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427935.414104:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5c00/0x2bea1a57ca3442e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427935.414120:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5c00/0x2bea1a57ca3442e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789427935.414222:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789427935.414228:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789427935.414277:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5c00/0x2bea1a57ca3442e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427935.414327:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4e00/0x2bea1a57ca3442e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8abb expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427935.414349:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5c00/0x2bea1a57ca3442e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8abb expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427935.414357:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:2.0:1789427935.414360:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789427935.414365:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5c00, rc 0) 00000100:00100000:2.0:1789427935.414442:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:12295:x1876350857220480:12345-192.168.201.55@tcp:101:lsof.0 Request processed in 495us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427935.414450:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 238 00000100:00080000:3.0:1789427935.414635:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789427935.433630:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427936.459356:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427936.724599:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427936.724727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857220736 00000100:00100000:3.0:1789427936.724741:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857220736 00000100:00100000:3.0:1789427936.724842:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 66 00000100:00100000:3.0:1789427936.724857:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+18:12296:x1876350857220736:12345-192.168.201.55@tcp:35:umount.0 00000100:00080000:2.0:1789427936.725047:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789427936.725600:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+19:12296:x1876350857220736:12345-192.168.201.55@tcp:35:umount.0 Request processed in 745us (1015us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789427936.725609:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 66 00000100:00100000:0.0:1789427936.735843:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427936.735966:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857220992 00000100:00100000:2.0:1789427936.735980:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857220992 00000100:00100000:2.0:1789427936.736123:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 67 00000100:00100000:2.0:1789427936.736138:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+19:12296:x1876350857220992:12345-192.168.201.55@tcp:35:umount.0 00000100:00100000:2.0:1789427936.736636:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:691432fe-93d9-4afe-b1ac-013e2024784c+20:12296:x1876350857220992:12345-192.168.201.55@tcp:35:umount.0 Request processed in 500us (808us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789427936.736645:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 67 00000100:00100000:1.0:1789427936.740996:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789427936.749972:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857221248 00000100:00100000:0.0:1789427936.749994:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857221248 00000100:00100000:0.0:1789427936.750088:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 68 00000100:00100000:0.0:1789427936.750165:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933419a95050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+20:12296:x1876350857221248:12345-192.168.201.55@tcp:35:umount.0 00000100:00100000:0.0:1789427936.750891:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933419a95050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+21:12296:x1876350857221248:12345-192.168.201.55@tcp:35:umount.0 Request processed in 727us (9906us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789427936.750901:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 68 00000100:00100000:0.0:1789427936.774072:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427936.774161:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857221504 00000100:00100000:3.0:1789427936.774226:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857221504 00000100:00100000:3.0:1789427936.774309:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 69 00000100:00100000:3.0:1789427936.774323:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+21:12296:x1876350857221504:12345-192.168.201.55@tcp:35:umount.0 00000100:00100000:3.0:1789427936.774992:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:691432fe-93d9-4afe-b1ac-013e2024784c+22:12296:x1876350857221504:12345-192.168.201.55@tcp:35:umount.0 Request processed in 670us (935us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789427936.775002:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 69 00000100:00100000:3.0:1789427936.782779:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427936.782908:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427936.790222:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427936.790361:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857221760 00000100:00100000:2.0:1789427936.790376:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857221760 00000100:00100000:2.0:1789427936.790481:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857221632 00000100:00100000:2.0:1789427936.790485:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857221632 00000100:00100000:2.0:1789427936.790525:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:2.0:1789427936.790538:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+14:2355:x1876350857221760:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427936.790588:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427936.790632:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401526000/0x2bea1a57ca3432d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8615 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427936.790658:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427936.790730:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+13:2355:x1876350857221760:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 195us (7967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427936.790738:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:2.0:1789427936.790763:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:2.0:1789427936.790770:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:2355:x1876350857221632:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427936.790785:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427936.790794:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7600/0x2bea1a57ca34330d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a864d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427936.790805:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427936.790823:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:2355:x1876350857221632:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 53us (7915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427936.790829:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:1.0:1789427936.795792:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427936.797155:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857221888 00000100:00100000:2.0:1789427936.797199:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857221888 00000100:00100000:2.0:1789427936.797309:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00100000:2.0:1789427936.797322:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:2355:x1876350857221888:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427936.797345:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427936.797371:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e179a00/0x2bea1a57ca343583 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8718 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427936.797396:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427936.797518:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2355:x1876350857221888:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 199us (7314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427936.797526:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00100000:3.0:1789427936.802472:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857222016 00000100:00100000:3.0:1789427936.802495:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857222016 00000100:00100000:3.0:1789427936.802747:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 72 00000100:00100000:3.0:1789427936.802761:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+5:2353:x1876350857222016:12345-192.168.201.55@tcp:9:umount.0 00000020:00000080:3.0:1789427936.802804:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343647 00000100:00080000:3.0:1789427936.802816:0:6685:0:(import.c:65:import_set_state_nolock()) ffff933408302000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789427936.802878:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789427936.803395:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:691432fe-93d9-4afe-b1ac-013e2024784c+2:2353:x1876350857222016:12345-192.168.201.55@tcp:9:umount.0 Request processed in 636us (7617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427936.803405:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 72 00010000:00010000:1.0:1789427936.805765:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427936.812894:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427936.812998:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857222400 00000100:00100000:3.0:1789427936.813012:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857222400 00000100:00080000:2.0:1789427936.813128:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789427936.813134:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789427936.823762:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 73 00000100:00100000:0.0:1789427936.823791:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+7:2353:x1876350857222400:12345-192.168.201.55@tcp:9:umount.0 00000020:00000080:0.0:1789427936.823842:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3438af 00000020:00010000:0.0:1789427936.823857:0:6684:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93341c3fa000: total 0 00000100:00080000:0.0:1789427936.823863:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93341c3f8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789427936.823934:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1789427936.824317:0:7626:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93341c3fa000: total 0 00010000:00010000:2.0:1789427936.824374:0:7626:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93341c3fa000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789427936.824446:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3442db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ab4 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427936.824495:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000057119fb/0x2bea1a57ca343c4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88ed expref: 5 pid: 8466 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427936.824512:0:7626:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93341c3fa000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789427936.824525:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427936.824527:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427936.824529:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427936.824723:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:691432fe-93d9-4afe-b1ac-013e2024784c+2:2353:x1876350857222400:12345-192.168.201.55@tcp:9:umount.0 Request processed in 944us (11842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427936.824733:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 73 00000100:00100000:0.0:1789427936.833102:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427936.833268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857223424 00000100:00100000:1.0:1789427936.833286:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857223424 00000100:00100000:1.0:1789427936.833383:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 239 00000100:00100000:1.0:1789427936.833396:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+22:2353:x1876350857223424:12345-192.168.201.55@tcp:39:umount.0 00000020:00000080:1.0:1789427936.833462:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3432e3 00000020:00010000:1.0:1789427936.833495:0:5836:0:(genops.c:1920:obd_stale_export_put()) Put export ffff933420e26000: total 0 00000100:00080000:1.0:1789427936.833503:0:5836:0:(import.c:65:import_set_state_nolock()) ffff933420e23000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789427936.833549:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1789427936.834062:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:691432fe-93d9-4afe-b1ac-013e2024784c+21:2353:x1876350857223424:12345-192.168.201.55@tcp:39:umount.0 Request processed in 667us (973us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789427936.834072:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 239 00000020:00010000:0.0:1789427936.834902:0:5824:0:(genops.c:1906:obd_stale_export_get()) Get export ffff933420e26000: total 0 00010000:00010000:0.0:1789427936.834976:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff933420e26000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789427936.835028:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427936.835032:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789427936.835046:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02bc00/0x2bea1a57ca343c36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88e6 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835072:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93342215bf00) 00010000:00010000:0.0:1789427936.835075:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427936.835080:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02aa00/0x2bea1a57ca3435ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8726 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835106:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427936.835109:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427936.835124:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca343b2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88a0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835140:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427936.835142:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427936.835147:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179800/0x2bea1a57ca34429c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a9f expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835161:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:0.0:1789427936.835164:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789427936.835169:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34361d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8742 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835219:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:0.0:1789427936.835222:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789427936.835262:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca343c9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8902 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835280:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff933408914100) 00010000:00010000:0.0:1789427936.835282:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789427936.835286:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031c00/0x2bea1a57ca34390a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8814 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835307:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:0.0:1789427936.835309:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789427936.835314:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400030400/0x2bea1a57ca343f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a89db expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835330:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427936.835333:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789427936.835337:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e179200/0x2bea1a57ca3442c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8aad expref: 12 pid: 8694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835349:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9334083caf00) 00010000:00010000:0.0:1789427936.835352:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789427936.835355:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933400031e00/0x2bea1a57ca3441bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8a67 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835374:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93342215b400) 00010000:00010000:0.0:1789427936.835377:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789427936.835381:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933401490c00/0x2bea1a57ca343cbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8909 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835402:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933408914900) 00010000:00010000:0.0:1789427936.835411:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789427936.835417:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca3435c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a872d expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835435:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93342215b000) 00010000:00010000:0.0:1789427936.835438:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789427936.835441:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93341e02b200/0x2bea1a57ca343c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a88d8 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427936.835457:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff933420e26000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789427936.835474:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427936.835477:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427936.835479:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427937.246844:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427937.246919:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789427937.247021:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857223552 00000100:00100000:3.0:1789427937.247036:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857223552 00000100:00100000:1.0:1789427937.247254:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857223680 00000100:00100000:1.0:1789427937.247259:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857223680 00000100:00100000:3.0:1789427937.248857:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 308 00000100:00100000:3.0:1789427937.248886:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2357:x1876350857223552:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789427937.249020:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334060ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2357:x1876350857223552:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 148us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427937.249029:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 308 00000100:00100000:1.0:1789427937.249710:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 183 00000100:00100000:1.0:1789427937.249722:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:2357:x1876350857223680:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789427937.249784:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:2357:x1876350857223680:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 65us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427937.249792:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 183 00000100:00080000:0.0:1789427937.251897:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789427937.481869:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427938.505550:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789427938.808126:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1789427938.808151:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000001:00080000:3.0:1789427938.808159:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1789427938.808230:0:5856:0:(genops.c:885:class_export_put()) final put ffff933420e26000/691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:0.0:1789427938.808349:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff933420e26000/691432fe-93d9-4afe-b1ac-013e2024784c for lustre-MDT0000 00000020:00000080:0.0:1789427938.808529:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff933420e23000 for lustre-MDT0000 00000100:00100000:0.0:1789427939.273607:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789427939.273642:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877125504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789427939.273746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427939.274219:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877125504 00000100:00100000:2.0:1789427939.274241:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877125504 00000100:00100000:2.0:1789427939.274329:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789427939.274341:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877125504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789427939.274401:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789427939.274465:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877125504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427939.274472:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789427939.274716:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789427939.274766:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877125504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789427939.380691:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427939.380754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427939.380797:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427939.380829:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857223808 00000100:00100000:2.0:1789427939.380843:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857223808 00000100:00100000:2.0:1789427939.380914:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857223936 00000100:00100000:2.0:1789427939.380918:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857223936 00000100:00100000:2.0:1789427939.380931:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857224064 00000100:00100000:2.0:1789427939.380933:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857224064 00000100:00100000:2.0:1789427939.380950:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:2.0:1789427939.380961:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+12:2355:x1876350857223808:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427939.380980:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427939.381006:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e179400/0x2bea1a57ca3433b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8662 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427939.381028:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427939.381109:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+11:2355:x1876350857223808:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 149us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427939.381118:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:2.0:1789427939.381139:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 23 00000100:00100000:2.0:1789427939.381145:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+10:2354:x1876350857223936:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427939.381154:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427939.381162:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02b000/0x2bea1a57ca34357c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8711 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427939.381215:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427939.381249:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+9:2354:x1876350857223936:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 104us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427939.381257:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 23 00000100:00100000:2.0:1789427939.381279:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:2.0:1789427939.381285:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+8:2354:x1876350857224064:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789427939.381295:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427939.381304:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02b600/0x2bea1a57ca3433bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a868c expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427939.381313:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427939.381331:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c70afe5-5dfb-4970-8818-ca41fe0a6309+7:2354:x1876350857224064:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 47us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427939.381338:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:1.0:1789427939.389956:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789427939.389998:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857224320 00000100:00100000:1.0:1789427939.390011:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857224320 00000100:00100000:1.0:1789427939.390102:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 240 00000100:00100000:1.0:1789427939.390115:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+6:2353:x1876350857224320:12345-192.168.201.55@tcp:39:umount.0 00000020:00000080:1.0:1789427939.390168:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3433ca 00000020:00010000:1.0:1789427939.390198:0:5836:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93340f10f800: total 0 00000100:00080000:1.0:1789427939.390204:0:5836:0:(import.c:65:import_set_state_nolock()) ffff93340f108000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789427939.390241:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1789427939.390710:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a378096-12fe-46c6-8e00-dd5f71de0c2d+5:2353:x1876350857224320:12345-192.168.201.55@tcp:39:umount.0 Request processed in 596us (766us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789427939.390720:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 240 00000020:00010000:1.0:1789427939.390778:0:7626:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93340f10f800: total 0 00010000:00010000:1.0:1789427939.390824:0:7626:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93340f10f800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789427939.390867:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933408914b00) 00010000:00010000:1.0:1789427939.390872:0:7626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789427939.390882:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5c00/0x2bea1a57ca3442e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8abb expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427939.390905:0:7626:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93340f10f800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789427939.390916:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427939.390918:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427939.390919:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789427939.390928:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789427939.394381:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:2.0:1789427939.394396:0:6710:0:(genops.c:885:class_export_put()) final put ffff93341c3fa000/691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:0.0:1789427939.395758:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93341c3fa000/691432fe-93d9-4afe-b1ac-013e2024784c for lustre-OST0000 00000020:00000080:0.0:1789427939.395834:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93341c3f8000 for lustre-OST0000 00000001:00100000:3.0:1789427939.401668:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:3.0:1789427939.401682:0:7637:0:(genops.c:885:class_export_put()) final put ffff933408305800/691432fe-93d9-4afe-b1ac-013e2024784c 00000020:00000080:3.0:1789427939.401734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff933408305800/691432fe-93d9-4afe-b1ac-013e2024784c for lustre-OST0001 00000020:00000080:3.0:1789427939.401787:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff933408302000 for lustre-OST0001 00000100:00100000:1.0:1789427939.418944:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789427939.419462:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857224576 00000100:00100000:2.0:1789427939.419478:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857224576 00000100:00100000:2.0:1789427939.419557:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 309 00000100:00100000:2.0:1789427939.419689:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+7:2353:x1876350857224576:12345-192.168.201.55@tcp:251:umount.0 00000020:00000080:2.0:1789427939.419749:0:5827:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3432c0 00000020:00010000:2.0:1789427939.419758:0:5827:0:(genops.c:1920:obd_stale_export_put()) Put export ffff933420e22000: total 0 00000100:00080000:2.0:1789427939.419764:0:5827:0:(import.c:65:import_set_state_nolock()) ffff933420e20000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789427939.419895:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c70afe5-5dfb-4970-8818-ca41fe0a6309+3:2353:x1876350857224576:12345-192.168.201.55@tcp:251:umount.0 Request processed in 210us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427939.419904:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 309 00000020:00010000:0.0:1789427939.428502:0:5824:0:(genops.c:1906:obd_stale_export_get()) Get export ffff933420e22000: total 0 00010000:00010000:0.0:1789427939.428515:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427939.428732:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff933420e22000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789427939.428784:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7400/0x2bea1a57ca343314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8654 expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427939.428805:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff933420e22000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789427939.428836:0:5824:0:(genops.c:885:class_export_put()) final put ffff933420e22000/5c70afe5-5dfb-4970-8818-ca41fe0a6309 00010000:00010000:2.0:1789427939.428855:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427939.428857:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427939.428860:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789427939.429328:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff933420e22000/5c70afe5-5dfb-4970-8818-ca41fe0a6309 for MGS 00000020:00000080:0.0:1789427939.429393:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff933420e20000 for MGS 00010000:00010000:0.0:1789427939.529539:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427940.303472:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343a8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877125760:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.303543:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427940.303607:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877126272:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.303643:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427940.303676:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789427940.303682:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343a8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877125632:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.303710:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427940.303731:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877126144:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.303765:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427940.303789:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343a8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877125888:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.303810:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427940.303827:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789427940.303832:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877126016:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.303853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427940.303883:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877125760 00000100:00100000:1.0:1789427940.303891:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877125760 00000100:00100000:1.0:1789427940.303934:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877126144 00000100:00100000:1.0:1789427940.303937:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877126144 00000100:00100000:1.0:1789427940.303957:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877125888 00000100:00100000:1.0:1789427940.303959:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877125888 00000100:00100000:1.0:1789427940.303974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789427940.303982:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877125760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.304032:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877125760:12345-0@lo:400:kworker.0 Request processed in 50us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427940.304039:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789427940.304068:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789427940.304074:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877126144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.304102:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877126144:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427940.304108:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789427940.304127:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789427940.304134:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877125888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.304168:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877125888:12345-0@lo:400:kworker.0 Request processed in 35us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427940.304195:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789427940.304214:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877126272 00000100:00100000:1.0:1789427940.304217:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877126272 00000100:00100000:1.0:1789427940.304538:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877126016 00000100:00100000:1.0:1789427940.304551:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877126016 00000100:00100000:1.0:1789427940.304574:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789427940.304580:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877126272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.304614:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877126272:12345-0@lo:400:kworker.0 Request processed in 34us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427940.304620:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789427940.304632:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789427940.304638:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340e1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877126016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.304664:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340e1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877126016:12345-0@lo:400:kworker.0 Request processed in 27us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427940.304671:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789427940.304687:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877125632 00000100:00100000:1.0:1789427940.304691:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877125632 00000100:00100000:1.0:1789427940.304717:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789427940.304723:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877125632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.304896:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933411bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3299:x1876350877125632:12345-0@lo:400:kworker.0 Request processed in 173us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427940.304903:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:1.0:1789427940.304985:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789427940.304998:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789427940.305026:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343a8c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877125632:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.305041:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877126144:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.305062:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343a8c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877125760:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.305073:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877126272:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.305107:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877126016:0@lo:400:kworker.0 00000100:00100000:1.0:1789427940.305115:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343a8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877125888:0@lo:400:kworker.0 00000100:00100000:3.0:1789427940.311347:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877126400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789427940.311416:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427940.311470:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877126400 00000100:00100000:3.0:1789427940.311478:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877126400 00000100:00100000:3.0:1789427940.311523:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789427940.311532:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877126400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789427940.311581:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789427940.311627:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877126400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427940.311634:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789427940.311684:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877126400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789427940.561424:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789427941.364777:0:12968:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789427941.380699:0:12968:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789427941.380772:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.380792:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.380801:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.380809:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.380832:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789427941.380839:0:12968:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789427941.380932:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789427941.380938:0:12968:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789427941.380947:0:12968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789427941.380980:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9334335f5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789427941.381053:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877126528:0@lo:39:umount.0 00000100:00100000:3.0:1789427941.381150:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427941.381332:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877126528 00000100:00100000:0.0:1789427941.381344:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877126528 00010000:00010000:1.0:1789427941.381358:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427941.381375:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.381388:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02b800 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427941.381393:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.381406:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427941.381415:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427941.381417:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 10000000:01000000:1.0:1789427941.381429:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789427941.381438:0:7626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:0.0:1789427941.381438:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876350877126528:12345-0@lo:39:umount.0 10000000:01000000:1.0:1789427941.381446:0:7626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000020:00000080:0.0:1789427941.381479:0:5834:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3430cf 00000100:00080000:0.0:1789427941.381491:0:5834:0:(import.c:65:import_set_state_nolock()) ffff93343ae99800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789427941.381504:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.381532:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427941.381571:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.381578:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02b800/0x2bea1a57ca343353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca34335a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.381595:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427941.381597:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427941.381598:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427941.381625:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877126656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427941.381696:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789427941.381738:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427941.381783:0:11166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877126656 00000100:00100000:1.0:1789427941.381792:0:11166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877126656 00000100:00100000:0.0:1789427941.381822:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3297:x1876350877126528:12345-0@lo:39:umount.0 Request processed in 389us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427941.381832:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789427941.381856:0:11166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789427941.381867:0:11166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3301:x1876350877126656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427941.381880:0:11166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427941.381894:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7200/0x2bea1a57ca34335a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca343353 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.381908:0:11166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427941.381953:0:11166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3301:x1876350877126656:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427941.381961:0:11166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:0.0:1789427941.381967:0:5834:0:(genops.c:885:class_export_put()) final put ffff93343ae9d800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1789427941.382055:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877126656:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789427941.382061:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93343ae9d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789427941.382132:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93343ae99800 for lustre-MDT0000 00000100:00080000:3.0:1789427941.382434:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9334335f5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789427941.382487:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877126528:0@lo:39:umount.0 00000100:00080000:2.0:1789427941.382529:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789427941.382533:0:12968:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789427941.382539:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789427941.385531:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385552:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385559:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385566:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385589:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789427941.385595:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385602:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385609:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385615:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385637:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789427941.385644:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385651:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.385672:0:7625:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789427941.385675:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385688:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.385691:0:7625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.385706:0:7625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178800 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:3.0:1789427941.385711:0:7625:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385711:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789427941.385729:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.385733:0:7625:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385741:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.385748:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789427941.385749:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.385761:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385794:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789427941.385796:0:7625:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.385798:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02b400 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427941.385807:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427941.385831:0:7625:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427941.385844:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789427941.385846:0:7625:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789427941.385852:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427941.385855:0:12968:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:00010000:1.0:1789427941.385861:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427941.385864:0:12968:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:1.0:1789427941.385869:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789427941.385872:0:7626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789427941.385874:0:7626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789427941.385901:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789427941.385907:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.385911:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.385914:0:7625:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.385924:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031000 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789427941.385932:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.385942:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789427941.385957:0:7625:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427941.385975:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.385981:0:7625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.385982:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02b400/0x2bea1a57ca34327a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343281 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.386013:0:7625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e178800/0x2bea1a57ca343361 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343368 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.386016:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427941.386022:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.386042:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933401491200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427941.386045:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.386056:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427941.386060:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427941.386063:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427941.386066:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427941.386076:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427941.386081:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789427941.386083:0:7626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789427941.386085:0:7626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789427941.386103:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427941.386108:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.386115:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427941.386147:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.386154:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401491200/0x2bea1a57ca34302e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343035 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.386168:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427941.386169:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427941.386171:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427941.386223:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877126784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427941.386261:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877127040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427941.386321:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427941.386391:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789427941.386399:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877126912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427941.386428:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427941.386464:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427941.386505:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877126784 00000100:00100000:1.0:1789427941.386516:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877126784 00000100:00100000:3.0:1789427941.386545:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877126912 00000100:00100000:3.0:1789427941.386555:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877126912 00000100:00100000:3.0:1789427941.386614:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877127040 00000100:00100000:3.0:1789427941.386618:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877127040 00000100:00100000:3.0:1789427941.386639:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789427941.386650:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+20:3298:x1876350877126912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427941.386668:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427941.386686:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02a600/0x2bea1a57ca343368 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca343361 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.386710:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427941.386754:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+19:3298:x1876350877126912:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427941.386762:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789427941.386781:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789427941.386787:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+18:3300:x1876350877127040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427941.386795:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427941.386803:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400030a00/0x2bea1a57ca343035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca34302e expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427941.386816:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427941.386842:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+17:3300:x1876350877127040:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427941.386848:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789427941.386901:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877127040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427941.387078:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789427941.387090:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+16:3298:x1876350877126784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789427941.387094:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.387104:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:2.0:1789427941.387105:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427941.387114:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789427941.387117:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789427941.387120:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789427941.387122:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02ac00/0x2bea1a57ca343281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca34327a expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.387143:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789427941.387149:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.387159:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427941.387213:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427941.387221:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34356e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343575 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427941.387228:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877127168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427941.387231:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:3298:x1876350877126784:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427941.387253:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789427941.387260:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427941.387264:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427941.387267:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427941.387301:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877126912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427941.387310:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877126784:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1789427941.387377:0:12968:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789427941.387383:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789427941.387388:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427941.387394:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1789427941.387400:0:12968:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93341da33800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789427941.387407:0:12968:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9333012a4800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789427941.387419:0:12968:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff93340f10f800 6a378096-12fe-46c6-8e00-dd5f71de0c2d 192.168.201.55@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1789427941.387422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789427941.387436:0:12968:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff933406148000) has exports, disconnecting them 00000020:00080000:2.0:1789427941.387442:0:12968:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93341da33800), last request at 1789427940 00000020:00000080:2.0:1789427941.387451:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343242 00000100:00080000:2.0:1789427941.387477:0:12968:0:(import.c:65:import_set_state_nolock()) ffff93341da36000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789427941.387531:0:12968:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93341da33800): rc 0 00000020:00000080:2.0:1789427941.387534:0:12968:0:(genops.c:885:class_export_put()) final put ffff93341da33800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789427941.387551:0:12968:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9333012a4800), last request at 1789427940 00000020:00000080:2.0:1789427941.387555:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343177 00000100:00080000:2.0:1789427941.387560:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9333012a6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789427941.387572:0:12968:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9333012a4800): rc 0 00000020:00000080:2.0:1789427941.387574:0:12968:0:(genops.c:885:class_export_put()) final put ffff9333012a4800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789427941.387588:0:12968:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9e6b415afae0 00000100:00080000:2.0:1789427941.387607:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789427941.387610:0:12968:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789427941.387626:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789427941.387701:0:12968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789427941.387716:0:12968:0:(import.c:65:import_set_state_nolock()) ffff93343fb4f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789427941.387731:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789427941.387733:0:12968:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789427941.387742:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789427941.387811:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877127296:0@lo:9:umount.0 00000100:00100000:2.0:1789427941.387858:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789427941.387895:0:12968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789427941.387906:0:12968:0:(import.c:65:import_set_state_nolock()) ffff93341004e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789427941.387924:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877127424:0@lo:9:umount.0 00000100:00100000:2.0:1789427941.387949:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427941.388118:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877127168 00000100:00100000:1.0:1789427941.388126:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877127168 00000100:00100000:1.0:1789427941.388161:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789427941.388168:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+15:3301:x1876350877127168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427941.388846:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427941.388865:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933420700000/0x2bea1a57ca343575 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca34356e expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427941.388881:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427941.388938:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3301:x1876350877127168:12345-0@lo:103:ldlm_bl.0 Request processed in 769us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427941.388959:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789427941.388990:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877127296 00000100:00100000:1.0:1789427941.388995:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877127296 00000100:00100000:1.0:1789427941.389029:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877127424 00000100:00100000:1.0:1789427941.389053:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877127424 00000100:00100000:1.0:1789427941.389078:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789427941.389085:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1876350877127296:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789427941.389108:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3431c4 00000100:00080000:1.0:1789427941.389115:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9333013f8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789427941.389150:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:3.0:1789427941.389457:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427941.389915:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3297:x1876350877127296:12345-0@lo:9:umount.0 Request processed in 828us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427941.389923:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789427941.389939:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789427941.389946:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1876350877127424:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789427941.389961:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3432ab 00000100:00080000:1.0:1789427941.389967:0:6685:0:(import.c:65:import_set_state_nolock()) ffff933420e24000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789427941.389998:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1789427941.390028:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789427941.390233:0:3297:0:(import.c:65:import_set_state_nolock()) ffff93343fb4f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789427941.390252:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3297:x1876350877127424:12345-0@lo:9:umount.0 Request processed in 305us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427941.390261:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1789427941.390262:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789427941.390267:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789427941.390274:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877127296:0@lo:9:umount.0 00000100:00080000:1.0:1789427941.390288:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1789427941.390322:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff933406148000) has no exports 00000100:00100000:1.0:1789427941.390335:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877127168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427941.390370:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789427941.390387:0:3297:0:(import.c:65:import_set_state_nolock()) ffff93341004e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789427941.390404:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789427941.390406:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789427941.390409:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343ae61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877127424:0@lo:9:umount.0 00000020:00000080:0.0:1789427941.391457:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93341da33800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1789427941.393497:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789427941.395451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9333012a4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789427941.395521:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93341da36000 for lustre-MDT0000 00000020:00000080:0.0:1789427941.395527:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9333012a6000 for lustre-MDT0000 00000020:00080000:3.0:1789427941.408786:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff933406148000) has no exports 00000020:00000080:3.0:1789427941.461506:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343089 00000020:00000080:3.0:1789427941.461525:0:12968:0:(genops.c:885:class_export_put()) final put ffff9334335f6000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789427941.461612:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789427941.461677:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9334335f6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789427941.461706:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427941.461716:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789427941.461720:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9334101b0000) has no exports 00000020:00000080:2.0:1789427941.462085:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343082 00000020:00000080:2.0:1789427941.462164:0:12968:0:(genops.c:885:class_export_put()) final put ffff93340f104800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789427941.462293:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93340f104800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789427941.462368:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427941.462379:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789427941.462383:0:12968:0:(genops.c:885:class_export_put()) final put ffff93340f102000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789427941.462387:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff93340f102000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789427941.462393:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1789427941.577748:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427942.601778:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427943.625372:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789427943.960210:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a378096-12fe-46c6-8e00-dd5f71de0c2d 00000001:00080000:3.0:1789427943.960229:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1789427943.960248:0:5856:0:(genops.c:885:class_export_put()) final put ffff93340f10f800/6a378096-12fe-46c6-8e00-dd5f71de0c2d 00000020:00000080:0.0:1789427943.960326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93340f10f800/6a378096-12fe-46c6-8e00-dd5f71de0c2d for lustre-MDT0000 00000020:00000080:0.0:1789427943.960382:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93340f108000 for lustre-MDT0000 00000001:00100000:2.0:1789427944.434805:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789427944.434815:0:6710:0:(genops.c:885:class_export_put()) final put ffff9333013fa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789427944.435038:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9333013fa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789427944.435099:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9333013f8000 for lustre-OST0000 00000001:00100000:3.0:1789427944.437146:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789427944.437154:0:7637:0:(genops.c:885:class_export_put()) final put ffff933420e25800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789427944.437528:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff933420e25800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789427944.437694:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff933420e24000 for lustre-OST0001 00010000:00010000:1.0:1789427944.653932:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427945.417883:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877127680:0@lo:400:kworker.0 00000100:00100000:0.0:1789427945.417902:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789427945.417919:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877127808:0@lo:400:kworker.0 00000100:00100000:1.0:1789427945.418003:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877127552:0@lo:400:kworker.0 00000100:00100000:0.0:1789427945.422522:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427945.422614:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877127808 00000100:00100000:3.0:1789427945.422625:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877127808 00000100:00100000:3.0:1789427945.422680:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789427945.422688:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876350877127808:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789427945.422697:0:5836:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789427945.422747:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876350877127808:12345-0@lo:400:kworker.0 Request processed in 58us (231us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789427945.422754:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1789427945.422952:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789427945.422970:0:3301:0:(import.c:65:import_set_state_nolock()) ffff933406acb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789427945.422974:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789427945.427122:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427945.427194:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427945.427287:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877127552 00000100:00100000:1.0:1789427945.427297:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877127552 00000100:00100000:1.0:1789427945.427412:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789427945.427423:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3298:x1876350877127552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789427945.427480:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca+14:3298:x1876350877127552:12345-0@lo:400:kworker.0 Request processed in 59us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427945.427488:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789427945.430375:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3298:1876350877127552:0@lo:400:kworker.0 00000100:00100000:3.0:1789427945.432886:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877127680 00000100:00100000:3.0:1789427945.432899:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877127680 00000100:00100000:3.0:1789427945.433736:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789427945.433746:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1876350877127680:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789427945.433755:0:5835:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789427945.433842:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343ae61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1876350877127680:12345-0@lo:400:kworker.0 Request processed in 96us (6727us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789427945.433850:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1789427945.434126:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789427945.434133:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9333012a6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789427945.434136:0:3299:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789427945.434142:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9333012a6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427945.434160:0:3299:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 176 00000100:00080000:2.0:1789427945.434170:0:3299:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9333012a6800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:2.0:1789427945.434282:0:3299:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93330387fb80 x1876350877127936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427945.434314:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877127680:0@lo:400:kworker.0 00000100:00100000:3.0:1789427945.434631:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876350877127936:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789427945.434676:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427945.434988:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877127936 00000100:00100000:1.0:1789427945.434995:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877127936 00000100:00100000:1.0:1789427945.435037:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789427945.435113:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876350877127936:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789427945.435130:0:5836:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789427945.446378:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876350877127936:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 11325us (11692us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789427945.446395:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1789427945.446410:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9333012a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789427945.446418:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789427945.446423:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876350877127936:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1789427945.455054:0:3301:0:(import.c:65:import_set_state_nolock()) ffff933406acb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789427945.455072:0:3301:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 196 00000100:00080000:0.0:1789427945.455089:0:3301:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff933406acb800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789427945.455841:0:3301:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343f994380 x1876350877128064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789427945.455880:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876350877127808:0@lo:400:kworker.0 00000100:00100000:2.0:1789427945.456193:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876350877128064:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789427945.456266:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427945.456484:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877128064 00000100:00100000:3.0:1789427945.456494:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877128064 00000100:00100000:3.0:1789427945.456545:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789427945.456562:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876350877128064:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1789427945.456580:0:5835:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789427945.456630:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876350877128064:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 76us (364us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789427945.456657:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1789427945.456985:0:3297:0:(import.c:65:import_set_state_nolock()) ffff933406acb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789427945.456991:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789427945.456995:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876350877128064:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1789427945.673536:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427946.697555:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789427947.529477:0:12968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933420f81c60 - data ffff93341539de58/ffff93343b637800 00000020:01000000:3.0:1789427947.529625:0:12968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933420f81600 - data ffff93342f7410d8/ffff93343b1bb400 00000001:00000004:3.0:1789427947.536105:0:12968:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1789427947.655723:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789427947.655731:0:12968:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789427947.655758:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789427947.655760:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789427947.657018:0:6839:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789427947.657025:0:6839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1789427947.657038:0:6839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789427947.658576:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789427947.658583:0:12968:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789427947.658608:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789427947.658611:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789427947.659079:0:8085:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789427947.659083:0:8085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1789427947.659093:0:8085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:1.0:1789427947.727409:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789427947.838234:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343051 00000020:00000080:2.0:1789427947.838248:0:12968:0:(genops.c:885:class_export_put()) final put ffff93341df73800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789427947.838286:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93341df73800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789427947.840889:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343066 00000020:00000080:2.0:1789427947.840906:0:12968:0:(genops.c:885:class_export_put()) final put ffff93341df76800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789427947.840936:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789427947.840942:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427947.840951:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789427947.840955:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff93340614b380) has no exports 00000020:00000080:0.0:1789427947.840988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93341df76800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1789427947.841137:0:12968:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789427947.841146:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3432a4 00000020:00000080:2.0:1789427947.841151:0:12968:0:(genops.c:885:class_export_put()) final put ffff93341da35000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789427947.841163:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789427947.841167:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427947.841190:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789427947.841193:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff933420f319c0) has no exports 00000020:00000080:2.0:1789427947.841200:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca34329d 00000020:00000080:2.0:1789427947.841205:0:12968:0:(genops.c:885:class_export_put()) final put ffff93341004d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789427947.841266:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93341da35000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789427947.841276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93341004d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789427947.842254:0:12968:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789427947.842260:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789427947.842265:0:12968:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1789427947.842271:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789427947.842273:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789427947.842307:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427947.842315:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789427947.842320:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3431bd 00000020:00000080:2.0:1789427947.842326:0:12968:0:(genops.c:885:class_export_put()) final put ffff93343fb4e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789427947.842330:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789427947.842334:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427947.842338:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789427947.842341:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9334101319c0) has no exports 00000020:00000080:2.0:1789427947.842346:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3431b6 00000020:00000080:2.0:1789427947.842349:0:12968:0:(genops.c:885:class_export_put()) final put ffff93343fb4a800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789427947.844086:0:12968:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789427947.844097:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789427947.844101:0:12968:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1789427947.844111:0:12968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789427947.844114:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789427947.844157:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427947.844168:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789427947.844403:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93341004e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789427947.844426:0:8:0:(genops.c:885:class_export_put()) final put ffff93343adb5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789427947.844430:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93343adb5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789427947.844438:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789427947.844532:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93343fb4e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789427947.844548:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93343fb4a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789427947.844553:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93343fb4f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789427947.844559:0:8:0:(genops.c:885:class_export_put()) final put ffff93343fb4e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789427947.844562:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93343fb4e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789427947.844565:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789427947.845011:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427947.845026:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789427947.845030:0:12968:0:(genops.c:885:class_export_put()) final put ffff933406060800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789427947.845033:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff933406060800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789427947.845039:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789427947.845294:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca34306d 00000020:00000080:2.0:1789427947.845302:0:12968:0:(genops.c:885:class_export_put()) final put ffff93341df75800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789427947.845352:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789427947.845357:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427947.845363:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789427947.845367:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff93340614cd40) has no exports 00000020:00000080:2.0:1789427947.845389:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427947.845393:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789427947.845397:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343074 00000020:00000080:2.0:1789427947.845401:0:12968:0:(genops.c:885:class_export_put()) final put ffff93341df72000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789427947.851795:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93341df75800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789427947.851809:0:8:0:(genops.c:885:class_export_put()) final put ffff93341df77800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789427947.851812:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93341df77800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789427947.851826:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789427947.854201:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93341df72000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789427947.854410:0:12968:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933433d9c800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789427947.854425:0:12968:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933433d9c800 3 00000020:01000004:0.0:1789427947.854428:0:12968:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff933433d9c800 from lustre-MDT0000 00000020:00000080:0.0:1789427947.854464:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427947.854474:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789427947.854479:0:12968:0:(genops.c:885:class_export_put()) final put ffff93341df76000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789427947.854482:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff93341df76000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789427947.854491:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789427947.854574:0:12968:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789427947.854578:0:12968:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789427947.854582:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789427947.854587:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427947.854591:0:12968:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789427947.854599:0:12968:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff933421f46800 cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789427947.854606:0:12968:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff933410134d40) has exports, disconnecting them 00000020:00080000:0.0:1789427947.854610:0:12968:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff933421f46800), last request at 1789427703 00000020:00000080:0.0:1789427947.854626:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343012 00000020:00010000:0.0:1789427947.854632:0:12968:0:(genops.c:1920:obd_stale_export_put()) Put export ffff933421f46800: total 0 00000100:00080000:0.0:1789427947.854638:0:12968:0:(import.c:65:import_set_state_nolock()) ffff933421f41800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789427947.854657:0:12968:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff933421f46800): rc 0 00000020:00080000:0.0:1789427947.854672:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff933410134d40) has no exports 00000020:00010000:1.0:1789427947.855776:0:5823:0:(genops.c:1906:obd_stale_export_get()) Get export ffff933421f46800: total 0 00010000:00010000:1.0:1789427947.855827:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff933421f46800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789427947.855860:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933420700800/0x2bea1a57ca343567 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca343560 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427947.855881:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02a200/0x2bea1a57ca34334c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca343345 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427947.855891:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e179000/0x2bea1a57ca343559 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca343552 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427947.855935:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401526e00/0x2bea1a57ca343376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca34336f expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427947.855946:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e02a800/0x2bea1a57ca34312a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca343123 expref: 5 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427947.855959:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401527a00/0x2bea1a57ca343322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca34331b expref: 4 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427947.855969:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933401526800/0x2bea1a57ca34333e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca343337 expref: 3 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427947.855978:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9334421c7c00/0x2bea1a57ca343330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bea1a57ca343329 expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427947.855988:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff933421f46800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789427947.856002:0:5823:0:(genops.c:885:class_export_put()) final put ffff933421f46800/cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca 00010000:00010000:1.0:1789427947.856021:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427947.856023:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427947.856025:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427947.856071:0:5828:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff933406af5600:5828] 1 exiting: rc = 0 00000020:00000080:0.0:1789427947.856276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff933421f46800/cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca for MGS 00000020:00000080:0.0:1789427947.856312:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff933421f41800 for MGS 00000100:00100000:2.0:1789427947.856712:0:5827:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff933406af4e00:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1789427947.856765:0:5829:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff933406af5800:5829] 2 exiting: rc = 0 00000100:00100000:0.0:1789427947.856864:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856872:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856888:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856897:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856903:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856908:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856913:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856928:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856935:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856941:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856946:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856953:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856959:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856964:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856970:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856975:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856980:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856985:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856991:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.856997:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857002:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857008:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857013:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857019:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857024:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857030:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857036:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857041:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857046:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857052:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857056:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857071:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857077:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857082:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857088:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857098:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857103:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857115:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857120:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857125:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857130:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857136:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857141:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857147:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857152:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857158:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857164:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857169:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857206:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857212:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857218:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857224:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857230:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857236:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857242:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857247:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857253:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857259:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857264:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857270:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857275:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857280:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857284:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427947.857290:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789427947.858831:0:12968:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789427947.858837:0:12968:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789427947.859833:0:12968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933420f813c0 - data ffff93343fe2d510/ffff93343b635400 00000020:01000000:0.0:1789427947.859970:0:12968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933407f60cc0 - data ffff93342f7c4000/ffff933410190c00 00000020:00000080:0.0:1789427947.860761:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca342ff6 00000020:00000080:0.0:1789427947.860770:0:12968:0:(genops.c:885:class_export_put()) final put ffff933433dad800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789427947.860826:0:12968:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933433d9c800 from MGS, refs=2 00000020:01000004:0.0:1789427947.860840:0:12968:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933433d9c800 2 00000020:01000004:0.0:1789427947.860844:0:12968:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff933433d9c800 from MGS 00000020:00000080:0.0:1789427947.860867:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427947.860874:0:12968:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789427947.860877:0:12968:0:(genops.c:885:class_export_put()) final put ffff933433da8800/MGS 00000020:00000080:0.0:1789427947.860880:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff933433da8800/MGS for MGS 00000020:01000000:0.0:1789427947.860886:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789427947.861823:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789427947.861830:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427947.861837:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789427947.861845:0:12968:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9334335f6800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789427947.861852:0:12968:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff93341da299c0) has exports, disconnecting them 00000020:00080000:0.0:1789427947.861856:0:12968:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9334335f6800), last request at 1789427704 00000020:00000080:0.0:1789427947.861861:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3430c1 00000020:00080000:0.0:1789427947.861876:0:12968:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9334335f6800): rc 0 00000020:00000080:0.0:1789427947.861880:0:12968:0:(genops.c:885:class_export_put()) final put ffff9334335f6800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789427947.872829:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff933433dad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789427947.876428:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9334335f6800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789427947.888276:0:12968:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789427947.888287:0:12968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789427947.888292:0:12968:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789427947.888300:0:12968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789427947.888556:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427947.888567:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789427947.888575:0:12968:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933433d9c800 1 00000020:00000080:2.0:1789427947.888582:0:12968:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca342fe8 00000020:00000080:2.0:1789427947.888591:0:12968:0:(genops.c:885:class_export_put()) final put ffff933433daa800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789427947.888597:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789427947.888605:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427947.888610:0:12968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789427947.888614:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff933410130000) has no exports 00000020:00000080:1.0:1789427947.897930:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9334335f5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789427947.897949:0:36:0:(genops.c:885:class_export_put()) final put ffff9334335f0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789427947.897953:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9334335f0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789427947.897961:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789427947.898029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff933433daa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789427947.919441:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427947.919456:0:12968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789427947.919462:0:12968:0:(genops.c:885:class_export_put()) final put ffff9334068bd800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789427947.919478:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff9334068bd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789427947.919486:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789427947.919640:0:12968:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9334068ba000 00000020:01000000:2.0:1789427947.919664:0:12968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789427947.919667:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789427947.919672:0:12968:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789427947.919676:0:12968:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9334061499c0) has no exports 00000100:00100000:2.0:1789427947.919739:0:8694:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9334105a3600:8694] 3 exiting: rc = 0 00000100:00100000:1.0:1789427947.922252:0:5836:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9334101bfc00:5836] 2 exiting: rc = 0 00000100:00100000:1.0:1789427947.926713:0:5834:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff93343373ac00:5834] 0 exiting: rc = 1 00000100:00100000:3.0:1789427947.990720:0:5835:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff93343373be00:5835] 1 exiting: rc = 0 00000100:00100000:2.0:1789427947.991126:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991134:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991140:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991147:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991152:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991157:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991163:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991168:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991221:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991227:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991232:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991237:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991243:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991248:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991261:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991267:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991272:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991277:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991284:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991289:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991294:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991299:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991307:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991313:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991318:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991323:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991340:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991345:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991350:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991355:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991361:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991366:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991372:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991377:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991383:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991389:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991394:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991399:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991404:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991418:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991423:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991429:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991434:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991439:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991444:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991449:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991454:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991458:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991463:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991468:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991473:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991478:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991483:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991487:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991493:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991497:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991503:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.991507:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.992401:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.992419:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.992425:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.992440:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.992446:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427947.992462:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.010503:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff933411aafe00:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1789427948.015862:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff933411aaf600:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1789427948.020845:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020859:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020865:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020870:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020876:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020881:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020886:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020892:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020898:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020904:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020909:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020926:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020934:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020939:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020945:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020950:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020956:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020962:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020967:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020973:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020978:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020984:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020989:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020994:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.020999:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021005:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021010:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021015:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021021:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021026:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021042:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021047:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021052:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021057:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021062:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021067:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021072:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021078:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021082:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021088:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021093:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021098:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021103:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021107:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021112:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021117:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021122:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021128:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021133:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021138:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021143:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021148:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021153:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021158:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021163:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021168:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021190:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021198:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021203:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021208:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021213:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021218:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021223:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.021229:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.022315:0:11961:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff93343facac00:11961] 2 exiting: rc = 0 00000100:00100000:1.0:1789427948.025215:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff933411aae200:5839] 0 exiting: rc = 1 00000100:00100000:0.0:1789427948.026363:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff933411aaec00:5840] 1 exiting: rc = 0 00000100:00100000:2.0:1789427948.026594:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026603:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026609:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026614:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026620:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026625:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026631:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026637:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026642:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026648:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026668:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026675:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026681:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026686:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026691:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026696:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026702:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026708:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026714:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026720:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026725:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026731:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026756:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026762:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026768:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026773:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026779:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026784:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026790:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026795:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026800:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026806:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026811:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026816:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026838:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026856:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026861:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026867:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026873:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026879:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026885:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026890:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026896:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026901:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026906:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026920:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026942:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026948:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026952:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026958:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026964:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026969:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026977:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026982:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.026994:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.027003:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.027014:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.027023:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.027048:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.027054:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.027060:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.027067:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.027074:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.027081:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.046281:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff933411aaf000:5842] 1 exiting: rc = 0 00000100:00100000:1.0:1789427948.047711:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff933411aaea00:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1789427948.047852:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047861:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047866:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047871:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047877:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047894:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047900:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047905:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047922:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047928:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047933:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047938:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047944:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047949:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047954:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047960:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047965:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047970:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047976:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047981:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047986:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047991:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.047997:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048002:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048007:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048013:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048018:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048023:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048029:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048034:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048039:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048044:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048050:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048055:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048060:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048066:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048071:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048076:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048081:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048086:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048099:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048104:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048110:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048115:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048120:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048125:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048130:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048136:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048141:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048146:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048151:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048156:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048161:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048166:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048171:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048203:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048208:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048213:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048218:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048223:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048227:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048232:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048237:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048242:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.048870:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff933411040200:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1789427948.049032:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff933411aae600:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1789427948.049292:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049299:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049305:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049309:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049314:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049320:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049325:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049331:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049336:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049341:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049354:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049359:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049365:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049370:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049374:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049380:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049385:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049390:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049395:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049400:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049405:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049410:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049415:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049420:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049424:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049429:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049435:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049440:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049445:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049450:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049456:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049460:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049465:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049470:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049475:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049480:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049485:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049490:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049514:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049520:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049525:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049530:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049535:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049539:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049544:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049557:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049562:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049567:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049572:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049577:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049583:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049588:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049594:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049598:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049604:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049609:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049614:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049619:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049624:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049629:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049634:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049639:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049644:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.049649:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050001:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff933411aae000:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1789427948.050279:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff933411aae800:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1789427948.050478:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050485:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050491:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050585:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050594:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050600:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050605:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050610:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050615:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050621:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050626:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050631:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050636:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050640:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050645:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050660:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050665:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050670:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050674:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050680:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050685:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050691:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050695:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050701:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050706:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050710:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050715:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050720:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050725:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050730:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050735:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050740:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050745:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050750:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050756:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050761:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050766:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050771:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050776:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050782:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050787:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050792:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050798:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050803:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050808:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050813:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050819:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050825:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050830:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050835:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050848:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050853:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050857:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050863:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050868:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050873:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050878:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050883:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050888:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050893:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050898:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050903:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050926:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.050931:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427948.052436:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff933411aafa00:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1789427948.053211:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff933411aaf800:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1789427948.053373:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9334081c0200:5849] 2 exiting: rc = 0 00000100:00100000:2.0:1789427948.053434:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053441:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053447:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053452:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053457:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053462:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053468:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053474:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053583:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053592:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053598:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053603:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053609:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053615:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053620:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053627:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053633:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053639:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053645:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053664:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053670:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053675:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053681:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053687:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053693:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053698:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053705:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053710:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053717:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053724:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053730:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053737:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053759:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053766:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053772:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053778:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053783:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053789:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053795:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053800:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053806:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053811:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053816:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053822:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053828:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053833:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053840:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053846:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053852:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053858:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053865:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053871:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053876:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053882:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053896:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053903:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053932:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053940:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053946:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053952:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053958:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053964:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053970:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427948.053976:0:12968:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789427948.060149:0:12968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427948.060165:0:12968:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789427948.060715:0:12968:0:(genops.c:885:class_export_put()) final put ffff933406062800/MDS_uuid 00000020:00000080:2.0:1789427948.060722:0:12968:0:(genops.c:844:class_export_destroy()) destroying export ffff933406062800/MDS_uuid for MDS 00000020:01000000:2.0:1789427948.060729:0:12968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789427948.060870:0:12968:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789427948.748563:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427949.769759:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789427950.544831:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789427950.544838:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789427950.544842:0:8:0:(import.c:65:import_set_state_nolock()) ffff9333012a6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789427950.544850:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 400 00000100:00080000:0.0:1789427950.544856:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789427950.544880:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9333012a6800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789427950.544905:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343f995c00 x1876350877128320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789427950.544923:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789427950.544927:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789427950.544928:0:8:0:(import.c:65:import_set_state_nolock()) ffff933406acb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789427950.544939:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 400 00000100:00080000:0.0:1789427950.544942:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789427950.544946:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff933406acb800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789427950.544958:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343f996680 x1876350877128448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789427950.544988:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877128192:0@lo:400:kworker.0 00000400:00000100:0.0:1789427950.545038:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350877128192 offset 0 length 224: 4 00000100:00100000:2.0:1789427950.545234:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876350877128320:0@lo:38:kworker.0 00000400:00000100:2.0:1789427950.545265:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350877128320 offset 0 length 520: 4 00000100:00100000:2.0:1789427950.545758:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876350877128448:0@lo:38:kworker.0 00000400:00000100:2.0:1789427950.545785:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350877128448 offset 0 length 520: 4 00010000:00010000:1.0:1789427950.799997:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789427951.064876:0:13125:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789427951.088068:0:13125:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789427951.088321:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.088336:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.088344:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.088351:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.088436:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789427951.088441:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789427951.088467:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789427951.088477:0:13125:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93343f995c00 x1876350877128320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789427965 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427951.088489:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789427951.088507:0:13125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789427951.088513:0:13125:0:(import.c:65:import_set_state_nolock()) ffff9333012a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789427951.088518:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789427951.088521:0:13125:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93343f995c00 x1876350877128320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789427965 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427951.088528:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789427951.088531:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1789427951.089206:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876350877128320:0@lo:38:kworker.0 00010000:00010000:1.0:1789427951.090357:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427951.090367:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427951.090379:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178e00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427951.090383:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427951.090392:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427951.090400:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427951.090406:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789427951.090410:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789427951.090413:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789427951.090448:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427951.090454:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789427951.090515:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789427951.090569:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090579:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090587:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427951.090592:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e178e00/0x2bea1a57ca343337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca34333e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090594:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090601:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427951.090606:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427951.090607:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427951.090608:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427951.090621:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789427951.090622:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090628:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427951.090628:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427951.090631:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090635:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427951.090638:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090641:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427951.090645:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090647:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427951.090649:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789427951.090651:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1789427951.090663:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090664:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789427951.090668:0:13125:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789427951.090669:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1789427951.090671:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789427951.090695:0:13125:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789427951.090700:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000100:00100000:0.0:1789427951.090702:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877128704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427951.090711:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427951.090715:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090721:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030000 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:3.0:1789427951.090723:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090729:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789427951.090735:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427951.090739:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789427951.090741:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789427951.090742:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789427951.090754:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090759:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789427951.090766:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789427951.090773:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090780:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400030000/0x2bea1a57ca343560 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca343567 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427951.090793:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427951.090795:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427951.090796:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789427951.090803:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789427951.090810:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000100:00100000:0.0:1789427951.090813:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877128576:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789427951.090814:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93341da28000) has no exports 00000100:00100000:0.0:1789427951.090832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789427951.090836:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93341da28000) has no exports 00000100:00100000:0.0:1789427951.090871:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877128832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427951.090897:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427951.090932:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877128704 00000100:00100000:0.0:1789427951.090941:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877128704 00000100:00100000:0.0:1789427951.090970:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877128576 00000100:00100000:0.0:1789427951.090973:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877128576 00000100:00100000:0.0:1789427951.090981:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877128832 00000100:00100000:0.0:1789427951.090983:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877128832 00000100:00100000:0.0:1789427951.090994:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789427951.091001:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3299:x1876350877128704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789427951.091007:0:5821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789427951 with bad export cookie 3164370652538089490 00010000:00010000:2.0:1789427951.091467:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427951.091532:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427951.091551:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca343345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bea1a57ca34334c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427951.091580:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427951.091582:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427951.091583:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427951.091616:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789427951.091622:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f996300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3299:x1876350877128576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789427951.091627:0:5820:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789427951 with bad export cookie 3164370652538089490 00000100:00100000:1.0:1789427951.091683:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f996300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3299:x1876350877128576:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (848us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789427951.091690:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789427951.091710:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789427951.091713:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933407e63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3300:x1876350877128832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789427951.091717:0:5820:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789427951 with bad export cookie 3164370652538089490 00000100:00100000:1.0:1789427951.091744:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933407e63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3300:x1876350877128832:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (846us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789427951.091750:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789427951.091945:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789427951.091951:0:3299:0:(import.c:65:import_set_state_nolock()) ffff933406065000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789427951.091955:0:3299:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1789427951.092001:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:3.0:1789427951.093089:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933411aa1d20 - data ffff93342d033798/ffff933433dfec00 00000020:01000000:3.0:1789427951.093293:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93341da20600 - data ffff933301558438/ffff933301204c00 00000100:00100000:0.0:1789427951.097947:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3299:x1876350877128704:12345-0@lo:103:ldlm_bl.0 Request processed in 6939us (7174us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789427951.097959:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789427951.115034:0:3299:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.155@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789427951.115040:0:3299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789427951.115051:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93343f997800 x1876350877128192/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789427966 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427951.115458:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93341e216d80 x1876350877128704/t0(0) o103->MGC192.168.201.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789427967 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427951.115469:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93341e217b80 x1876350877128576/t0(0) o103->MGC192.168.201.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789427967 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427951.115478:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93343aca1880 x1876350877128832/t0(0) o103->MGC192.168.201.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789427967 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427951.115555:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3301:1876350877128192:0@lo:400:kworker.0 10000000:01000000:2.0:1789427951.115574:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789427951.115577:0:3299:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789427951.115579:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789427951.115594:0:3300:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff933406065000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789427951.115641:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3300:1876350877128832:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789427951.115724:0:3299:0:(import.c:65:import_set_state_nolock()) ffff933406065000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427951.115731:0:3299:0:(import.c:545:import_select_connection()) MGC192.168.201.155@tcp: connect to NID 0@lo last attempt 157 00000100:00080000:2.0:1789427951.115743:0:3299:0:(import.c:666:import_select_connection()) MGC192.168.201.155@tcp: import ffff933406065000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:3.0:1789427951.115844:0:3299:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343aca2680 x1876350877128960/t0(0) o250->MGC192.168.201.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427951.115911:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3297:1876350877128960:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1789427951.115956:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350877128960 offset 0 length 520: 4 00000100:00100000:3.0:1789427951.116016:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877128704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789427951.116021:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3299:1876350877128576:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1789427951.130036:0:13125:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789427951.158820:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343146 00000020:00000080:0.0:1789427951.158831:0:13125:0:(genops.c:885:class_export_put()) final put ffff93341e8aa000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789427951.158854:0:13125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933406156800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789427951.158867:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933406156800 2 00000020:01000004:0.0:1789427951.158870:0:13125:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff933406156800 from lustre-OST0000 00000020:00000080:0.0:1789427951.158896:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427951.158906:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789427951.158908:0:13125:0:(genops.c:885:class_export_put()) final put ffff93341e8aa800/lustre-OST0000_UUID 00000020:00000080:0.0:1789427951.158912:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff93341e8aa800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789427951.158918:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789427951.158957:0:13125:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789427951.158962:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789427951.158966:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427951.158971:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789427951.158978:0:13125:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9333012a7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789427951.158983:0:13125:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9334101b19c0) has exports, disconnecting them 00000020:00080000:0.0:1789427951.158988:0:13125:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9333012a7000), last request at 1789427721 00000020:00000080:0.0:1789427951.158992:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343170 00000020:00080000:0.0:1789427951.159001:0:13125:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9333012a7000): rc 0 00000020:00000080:0.0:1789427951.159006:0:13125:0:(genops.c:885:class_export_put()) final put ffff9333012a7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789427951.159722:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93341e8aa000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789427951.159736:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9333012a7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789427951.161817:0:13125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789427951.161825:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789427951.161830:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789427951.161837:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789427951.162054:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789427951.162064:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1789427951.162070:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933406156800 1 00000020:00000080:1.0:1789427951.162077:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343100 00000020:00000080:1.0:1789427951.162085:0:13125:0:(genops.c:885:class_export_put()) final put ffff93343ae9e000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789427951.162090:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789427951.162095:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789427951.162099:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789427951.162103:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff93341da2b380) has no exports 00000020:00000080:2.0:1789427951.162642:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9333012a6800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789427951.162650:0:8:0:(genops.c:885:class_export_put()) final put ffff93340f108800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789427951.162652:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93340f108800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789427951.162658:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789427951.162719:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93343ae9e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789427951.184280:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789427951.184296:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789427951.184302:0:13125:0:(genops.c:885:class_export_put()) final put ffff933406151800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789427951.184307:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff933406151800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789427951.184321:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789427951.184455:0:13125:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff933406154800 00000020:02000400:2.0:1789427951.184504:0:13125:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789427951.825212:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427952.843438:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427953.866048:0:7625:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789427954.141448:0:13275:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789427954.152424:0:13275:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789427954.152509:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.152527:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.152535:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.152554:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.152578:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789427954.152583:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789427954.152604:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789427954.152616:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93343f996680 x1876350877128448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789427965 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427954.152635:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789427954.152640:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789427954.152647:0:13275:0:(import.c:65:import_set_state_nolock()) ffff933406acb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789427954.152652:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789427954.152655:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93343f996680 x1876350877128448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789427965 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427954.152662:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789427954.152664:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:2.0:1789427954.152700:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427954.152706:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.152714:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02a000 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789427954.152718:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.152727:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427954.152734:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427954.152739:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789427954.152742:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789427954.152744:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789427954.152755:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff933406065000 00010000:00010000:2.0:1789427954.152759:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.152765:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02a000/0x2bea1a57ca34331b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bea1a57ca343322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.152774:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427954.152776:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427954.152777:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427954.152829:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876350877128448:0@lo:38:kworker.0 00010000:00010000:0.0:1789427954.153883:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.153895:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.153902:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.153909:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.153941:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789427954.153948:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.153955:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.153961:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.153967:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.153979:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789427954.153983:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789427954.153997:0:13275:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789427954.154001:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789427954.154005:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427954.154010:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789427954.154014:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93341da2cd40) has no exports 00000020:00080000:0.0:1789427954.154033:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93341da2cd40) has no exports 00010000:00010000:3.0:1789427954.155837:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789427954.155849:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427954.155862:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e02ba00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:3.0:1789427954.155866:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427954.155876:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789427954.155896:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427954.155902:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789427954.155905:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789427954.155907:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789427954.155921:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff933406065000 00010000:00010000:3.0:1789427954.155926:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427954.155932:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e02ba00/0x2bea1a57ca343329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bea1a57ca343330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427954.155944:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789427954.155948:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427954.156052:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427954.156592:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:3.0:1789427954.156596:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427954.156603:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789427954.156609:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427954.156614:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789427954.156616:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789427954.156624:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789427954.156632:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff933406065000 00010000:00010000:3.0:1789427954.156636:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427954.156642:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933420700200/0x2bea1a57ca343552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bea1a57ca343559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427954.156655:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427954.156657:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427954.156659:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789427954.158142:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933411aa14e0 - data ffff93343fe90948/ffff933433dfd400 00000020:01000000:0.0:1789427954.158487:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93341056b4e0 - data ffff93343fe79870/ffff93343b6d6800 00100000:10000000:0.0:1789427954.176941:0:13275:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789427954.211756:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343211 00000020:00000080:0.0:1789427954.211764:0:13275:0:(genops.c:885:class_export_put()) final put ffff933406ac9000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789427954.211781:0:13275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93341d0db000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789427954.211784:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93341d0db000 2 00000020:01000004:0.0:1789427954.211787:0:13275:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93341d0db000 from lustre-OST0001 00000020:00000080:0.0:1789427954.211836:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789427954.211842:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff933406ac9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789427954.211847:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789427954.211853:0:13275:0:(genops.c:885:class_export_put()) final put ffff93343fb4c800/lustre-OST0001_UUID 00000020:00000080:0.0:1789427954.211855:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff93343fb4c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789427954.211865:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789427954.211960:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca->MGS 00010000:00010000:0.0:1789427954.211977:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca34312a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427954.211989:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca34312a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427954.211995:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789427954.211998:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789427954.212002:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789427954.212016:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff933406065000 00010000:00010000:0.0:1789427954.212020:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933401527000/0x2bea1a57ca343123 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bea1a57ca34312a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427954.212035:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bea1a57ca343376 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427954.212042:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bea1a57ca343376 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427954.212047:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789427954.212050:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789427954.212052:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789427954.212062:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff933406065000 00010000:00010000:0.0:1789427954.212064:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e178000/0x2bea1a57ca34336f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bea1a57ca343376 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789427954.212085:0:13275:0:(import.c:65:import_set_state_nolock()) ffff933406065000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789427954.212088:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789427954.212089:0:13275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789427954.212090:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789427954.212094:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789427954.212102:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93343aca2680 x1876350877128960/t0(0) o250->MGC192.168.201.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789427961 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789427954.212119:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789427954.212121:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1789427954.212471:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca:3297:1876350877128960:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:0.0:1789427954.212544:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789427954.212552:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca343004 00000020:00000080:0.0:1789427954.212557:0:13275:0:(genops.c:885:class_export_put()) final put ffff933406067800/cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca 00000020:01000000:0.0:1789427954.212572:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.155@tcp (flags='') 00000020:00000080:0.0:1789427954.212578:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427954.212583:0:13275:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.155@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789427954.212586:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9334101b3380) has no exports 10000000:01000000:2.0:1789427954.212635:0:5831:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1789427954.212697:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff933406067800/cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca for MGC192.168.201.155@tcp 10000000:01000000:0.0:1789427954.212735:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.155@tcp: client import never connected 00000100:00080000:0.0:1789427954.212737:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789427954.212739:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789427954.212741:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789427954.212743:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789427954.212781:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427954.212785:0:13275:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.155@tcp (uuid cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca) 00000020:01000000:0.0:1789427954.212791:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789427954.212794:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427954.212797:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789427954.212811:0:13275:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff933406ace000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789427954.212816:0:13275:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff93341deb4d40) has exports, disconnecting them 00000020:00080000:0.0:1789427954.212820:0:13275:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff933406ace000), last request at 1789427741 00000020:00000080:0.0:1789427954.212824:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca34323b 00000020:00080000:0.0:1789427954.212840:0:13275:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff933406ace000): rc 0 00000020:00000080:0.0:1789427954.212844:0:13275:0:(genops.c:885:class_export_put()) final put ffff933406ace000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789427954.213460:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff933406065000 for MGC192.168.201.155@tcp 00000020:00000080:3.0:1789427954.213469:0:8:0:(genops.c:885:class_export_put()) final put ffff933421f44800/cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca 00000020:00000080:3.0:1789427954.213472:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff933421f44800/cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca for MGC192.168.201.155@tcp 00000020:01000000:3.0:1789427954.213477:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.155@tcp (cda3c9a7-e333-4e58-8844-c1e3a5f0c5ca) 00000020:00000080:3.0:1789427954.213713:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff933406ace000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789427954.228372:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789427954.228484:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789427954.228490:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789427954.228498:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789427954.228678:0:7625:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789427954.228890:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789427954.228995:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1789427954.229121:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1789427954.229310:0:5819:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff933420226000:5819] 1 exiting: rc = 0 00000020:00000080:3.0:1789427954.229724:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff933406acb800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1789427954.229951:0:5818:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff933420227800:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1789427954.230069:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427954.231077:0:5820:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff933421b43200:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1789427954.231232:0:5821:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff933414f7fa00:5821] 1 exiting: rc = 0 00000100:00100000:3.0:1789427954.231424:0:11166:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9334052c4c00:11166] 3 exiting: rc = 0 00000100:00100000:2.0:1789427954.231704:0:5822:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff933411afca00:5822] 2 exiting: rc = 0 00000100:00100000:0.0:1789427954.231833:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231841:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231847:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231855:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231860:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231866:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231870:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231876:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231881:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231887:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231892:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231897:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231902:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231908:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231914:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231920:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231925:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231931:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231936:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231941:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231945:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231951:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231955:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231960:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231964:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231968:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231989:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231994:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.231998:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232003:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232008:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232013:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232017:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232022:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232027:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232032:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232037:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232042:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232046:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232051:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232056:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232061:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232066:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232071:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232076:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232081:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232086:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232091:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232096:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232102:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232106:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232110:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232115:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232120:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232125:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232130:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232135:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232140:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232145:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232150:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232155:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.232168:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.234937:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.234976:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789427954.246030:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427954.246042:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789427954.246047:0:13275:0:(genops.c:885:class_export_put()) final put ffff933406ac9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789427954.246052:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff933406ac9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789427954.246059:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789427954.246099:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93341d0db000 1 00000020:00000080:0.0:1789427954.246104:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2bea1a57ca3431e0 00000020:00000080:0.0:1789427954.246110:0:13275:0:(genops.c:885:class_export_put()) final put ffff933420e27800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789427954.246129:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789427954.246134:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427954.246138:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789427954.246142:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff933420f34d40) has no exports 00000020:00000080:3.0:1789427954.246245:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff933420e27800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789427954.266824:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427954.266841:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789427954.266847:0:13275:0:(genops.c:885:class_export_put()) final put ffff93340f10a800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789427954.266852:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff93340f10a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789427954.266859:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789427954.267058:0:13275:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93340f10a000 00000020:01000000:0.0:1789427954.267080:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789427954.267084:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789427954.267089:0:13275:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789427954.267093:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9334101b4d40) has no exports 00000020:00000080:0.0:1789427954.267120:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789427954.267127:0:13275:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789427954.267130:0:13275:0:(genops.c:885:class_export_put()) final put ffff93343ae98000/OSS_uuid 00000020:00000080:0.0:1789427954.267132:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff93343ae98000/OSS_uuid for OSS 00000020:01000000:0.0:1789427954.267136:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789427954.267306:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff93341005c200:6682] 0 exiting: rc = 1 00000100:00080000:1.0:1789427954.267505:0:5830:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789427954.267680:0:8466:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff93341de80000:8466] 3 exiting: rc = 0 00000100:00100000:1.0:1789427954.267762:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff93341005ce00:6685] 2 exiting: rc = 0 00000100:00100000:3.0:1789427954.275349:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff933420382a00:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1789427954.275897:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275908:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275915:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275939:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275945:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275951:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275958:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275964:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275970:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275975:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275982:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275987:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275992:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.275997:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276003:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276007:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276013:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276018:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276023:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276029:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276034:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276039:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276045:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276050:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276056:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276061:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276067:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276072:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276077:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276083:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276088:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276093:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276098:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276103:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276108:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276113:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276118:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276123:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276137:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276142:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276147:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276153:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276158:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276163:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276169:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276206:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276212:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276217:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276222:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276228:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276233:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276238:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276243:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276249:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276255:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276261:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276266:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276271:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276276:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276282:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276287:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276292:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276308:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.276322:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427954.277341:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93341dd68600:6687] 1 exiting: rc = 0 00000100:00100000:3.0:1789427954.277667:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93341005cc00:6686] 0 exiting: rc = 1 00000100:00100000:0.0:1789427954.277860:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277868:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277873:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277877:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277882:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277887:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277892:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277897:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277901:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277919:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277925:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277930:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277934:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277939:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277944:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277949:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277953:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277957:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277962:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277967:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277972:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277978:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277983:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277988:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.277994:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278000:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278005:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278009:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278014:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278019:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278024:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278029:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278034:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278038:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278044:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278050:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278056:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278061:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278067:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278072:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278077:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278082:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278088:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278094:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278106:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278112:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278118:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278124:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278129:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278135:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278140:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278145:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278150:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278154:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278158:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278163:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278168:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278659:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278670:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278677:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278683:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278689:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278694:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.278700:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789427954.286061:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93341228c000:6688] 0 exiting: rc = 1 00000100:00100000:3.0:1789427954.286400:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93343aa79800:6690] 2 exiting: rc = 0 00000100:00100000:2.0:1789427954.286852:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93341dd68c00:6689] 1 exiting: rc = 0 00000100:00100000:3.0:1789427954.287001:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287009:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287030:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287037:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287055:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287061:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287068:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287074:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287079:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287086:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287092:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287098:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287104:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287109:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287115:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287120:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287125:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287131:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287137:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287142:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287148:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287154:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287160:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287166:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287260:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287268:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287274:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287280:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287313:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287322:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287327:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287332:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287338:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287344:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287349:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287355:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287361:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287374:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287379:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287385:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287391:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287397:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287403:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287409:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287415:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287421:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287426:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287431:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287437:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287442:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287448:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287453:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287459:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287464:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287470:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287476:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287482:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287487:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287508:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287516:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287522:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287733:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287741:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789427954.287747:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.299368:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93343aa77e00:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1789427954.299972:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93343aa79400:6692] 1 exiting: rc = 0 00000100:00100000:2.0:1789427954.300291:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300362:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300368:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300374:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300390:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300396:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300401:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300407:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300413:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300418:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300423:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300429:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300434:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300439:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300444:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300449:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300455:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300460:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300465:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300470:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300475:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300499:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300505:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300510:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300515:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300520:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300525:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300633:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300639:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300644:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300649:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300654:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300658:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300663:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300668:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300673:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300678:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300683:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300688:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300693:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300697:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300701:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300706:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300711:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300715:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300719:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300724:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300728:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300732:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300737:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300741:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300746:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300750:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300755:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300759:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300764:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300768:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300772:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300777:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300781:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300785:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300790:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300809:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.300815:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789427954.302161:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93343aa77c00:6693] 0 exiting: rc = 1 00000100:00100000:1.0:1789427954.302692:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93343aa76000:6694] 1 exiting: rc = 0 00000100:00100000:2.0:1789427954.302851:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302863:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302869:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302876:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302883:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302889:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302898:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302905:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302912:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302931:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302938:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302944:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302951:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302958:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302963:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302968:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302974:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302980:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302985:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302991:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.302997:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303015:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303021:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303027:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303033:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303039:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303045:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303050:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303056:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303061:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303068:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303073:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303078:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303106:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303113:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303119:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303125:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303134:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303140:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303145:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303151:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303156:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303162:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303170:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303616:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303644:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303650:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303655:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303661:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303667:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303672:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303679:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303684:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303690:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303695:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303700:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303705:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303710:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303722:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303738:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303759:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303766:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303772:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789427954.303785:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789427954.320704:0:13275:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789427973.792728:0:13890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789427983.085373:0:14350:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789427983.085379:0:14350:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789427983.085520:0:14350:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9333031bc000 00000020:01000004:3.0:1789427983.085536:0:14350:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789427983.085544:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789427983.085556:0:14350:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff933410133380) 00000020:00000080:3.0:1789427983.085571:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789427983.119860:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789427983.124854:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789427983.125253:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 325: rc = 0 00100000:10000000:2.0:1789427983.125408:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 325: rc = 0 00100000:10000000:2.0:1789427983.125714:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 325: rc = 0 00100000:10000000:2.0:1789427983.125819:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 325: rc = 0 00100000:10000000:2.0:1789427983.125995:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789427983.126067:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 325: rc = 0 00100000:10000000:2.0:1789427983.126417:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 325: rc = 0 00100000:10000000:2.0:1789427983.127214:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 327: rc = 0 00100000:10000000:2.0:1789427983.128729:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 594: rc = 0 00100000:10000000:2.0:1789427983.128830:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 594: rc = 0 00100000:10000000:2.0:1789427983.129335:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:2.0:1789427983.129835:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1789427983.130087:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:2.0:1789427983.130743:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1789427983.131407:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1789427983.131942:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 775: rc = 0 00100000:10000000:2.0:1789427983.134096:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1789427983.134704:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 775: rc = 0 00100000:10000000:2.0:1789427983.134953:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:2.0:1789427983.135307:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1789427983.135922:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 775: rc = 0 00100000:10000000:2.0:1789427983.136369:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1789427983.139732:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 610: rc = 0 00100000:10000000:2.0:1789427983.140023:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 610: rc = 0 00100000:10000000:2.0:1789427983.141028:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 610: rc = 0 00100000:10000000:2.0:1789427983.141396:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 610: rc = 0 00100000:10000000:2.0:1789427983.141858:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 610: rc = 0 00100000:10000000:3.0:1789427983.142431:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 610: rc = 0 00100000:10000000:3.0:1789427983.144432:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 610: rc = 0 00100000:10000000:3.0:1789427983.145227:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 610: rc = 0 00100000:10000000:3.0:1789427983.145830:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 610: rc = 0 00100000:10000000:3.0:1789427983.146091:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 610: rc = 0 00100000:10000000:3.0:1789427983.146718:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 610: rc = 0 00100000:10000000:3.0:1789427983.147936:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 610: rc = 0 00100000:10000000:3.0:1789427983.149372:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 610: rc = 0 00100000:10000000:3.0:1789427983.149983:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 610: rc = 0 00100000:10000000:3.0:1789427983.150280:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 610: rc = 0 00100000:10000000:3.0:1789427983.150684:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 610: rc = 0 00100000:10000000:3.0:1789427983.150942:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 610: rc = 0 00100000:10000000:3.0:1789427983.151785:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 610: rc = 0 00100000:10000000:3.0:1789427983.152042:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 610: rc = 0 00100000:10000000:3.0:1789427983.152299:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 610: rc = 0 00100000:10000000:3.0:1789427983.153117:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 610: rc = 0 00100000:10000000:3.0:1789427983.154077:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 610: rc = 0 00100000:10000000:3.0:1789427983.156924:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 610: rc = 0 00100000:10000000:3.0:1789427983.157169:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 610: rc = 0 00100000:10000000:3.0:1789427983.157959:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 610: rc = 0 00100000:10000000:3.0:1789427983.160517:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 610: rc = 0 00100000:10000000:3.0:1789427983.161047:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 610: rc = 0 00100000:10000000:3.0:1789427983.161567:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 610: rc = 0 00100000:10000000:3.0:1789427983.161842:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 610: rc = 0 00100000:10000000:3.0:1789427983.162083:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 610: rc = 0 00100000:10000000:3.0:1789427983.162618:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 610: rc = 0 00100000:10000000:3.0:1789427983.162860:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 610: rc = 0 00100000:10000000:3.0:1789427983.163338:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 599: rc = 0 00100000:10000000:3.0:1789427983.163957:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789427983.167561:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 595: rc = 0 00100000:10000000:3.0:1789427983.167882:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789427983.167957:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 595: rc = 0 00100000:10000000:3.0:1789427983.168340:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789427983.168412:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 595: rc = 0 00100000:10000000:3.0:1789427983.168781:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789427983.168851:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:3.0:1789427983.169028:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789427983.169842:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:3.0:1789427983.170050:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789427983.171767:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00000020:00000080:3.0:1789427983.172060:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789427983.172068:0:14350:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789427983.172078:0:14350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca3442f7 00000020:01000004:3.0:1789427983.172087:0:14350:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789427983.172092:0:14350:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789427983.172097:0:14350:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9333031bc000 from MGS 00000020:01000004:3.0:1789427983.172100:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789427983.172110:0:14350:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff933410130000) 00000020:00000080:3.0:1789427983.172120:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789427983.172171:0:14350:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9333031bc000 from MGS, refs=2 00080000:01000000:2.0:1789427983.175414:0:14350:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789427983.175434:0:14350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca344305 00000100:00100000:2.0:1789427983.175669:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789427983.175893:0:14350:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789427983.175900:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789427983.180494:0:14350:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789427983.180506:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789427983.182110:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427983.182354:0:14350:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789427983.182361:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789427983.183202:0:14350:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789427983.183212:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789427983.183788:0:14350:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789427983.183794:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789427983.184409:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427983.184412:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427983.184413:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427983.184740:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427983.184742:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427983.184744:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427983.186062:0:14350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789427983.191213:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789427983.201234:0:14350:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789427983.201251:0:14350:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789427983.201253:0:14350:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789427983.207206:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789427983.207501:0:14350:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789427983.207608:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789427983.208097:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789427983.208447:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427983.208608:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789427983.208614:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789427983.216768:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789427983.216783:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789427983.223705:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789427983.223724:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789427983.224800:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789427983.224823:0:14350:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.155@tcp' 00000020:01000004:0.0:1789427983.224825:0:14350:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789427983.224857:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.155@tcp (typ=mgc) 00000020:00000080:0.0:1789427983.224871:0:14350:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.155@tcp (ffff93341deb4d40) 00000020:00000080:0.0:1789427983.224888:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789427983.224989:0:14350:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333013fa000@MGC192.168.201.155@tcp: add connection 192.168.201.155@tcp at head 00010000:00010000:0.0:1789427983.225206:0:14350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.155@tcp-0 is initialized 00000040:01000000:0.0:1789427983.225213:0:14350:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789427983.225571:0:14364:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789427983.227480:0:14365:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789427983.227559:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.155@tcp (uuid 92161c2e-b691-4539-8b6b-a6d322602ab0) 00000020:00000080:0.0:1789427983.227580:0:14350:0:(genops.c:1384:class_connect()) connect: client 92161c2e-b691-4539-8b6b-a6d322602ab0, cookie 0x2bea1a57ca344313 00000100:00080000:0.0:1789427983.227592:0:14350:0:(import.c:545:import_select_connection()) MGC192.168.201.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789427983.227603:0:14350:0:(import.c:666:import_select_connection()) MGC192.168.201.155@tcp: import ffff9333013fa000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789427983.227636:0:14350:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343f995880 x1876350877129088/t0(0) o250->MGC192.168.201.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789427983.227669:0:14350:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 92161c2e-b691-4539-8b6b-a6d322602ab0->MGS 00000020:01000004:0.0:1789427983.227694:0:14350:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789427983.227700:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789427983.227711:0:14350:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93341deb19c0) 00000020:00000080:0.0:1789427983.227723:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789427983.228228:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:92161c2e-b691-4539-8b6b-a6d322602ab0:3297:1876350877129088:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789427983.228304:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427983.229246:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877129088 00000100:00100000:1.0:1789427983.229257:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877129088 00000100:00100000:1.0:1789427983.229310:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427983.229318:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1876350877129088:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789427983.229343:0:14361:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 92161c2e-b691-4539-8b6b-a6d322602ab0@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1789427983.229370:0:14361:0:(genops.c:1384:class_connect()) connect: client 92161c2e-b691-4539-8b6b-a6d322602ab0, cookie 0x2bea1a57ca344321 00000100:00080000:1.0:1789427983.229500:0:14361:0:(import.c:65:import_set_state_nolock()) ffff93341dc53000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789427983.229578:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+5:3297:x1876350877129088:12345-0@lo:250:mount.lustre.0 Request processed in 259us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427983.229585:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427983.229634:0:3297:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789427983.229645:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.155@tcp: connect to target with instance 0 00000100:00080000:1.0:1789427983.229655:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789427983.229659:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789427983.229663:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9333013fa000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789427983.229666:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789427983.229675:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789427983.229681:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:92161c2e-b691-4539-8b6b-a6d322602ab0:3297:1876350877129088:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789427983.255033:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427983.265370:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789427983.265379:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789427983.268904:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789427983.268919:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789427983.271829:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789427983.271842:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789427983.272584:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427983.272768:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789427983.272773:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789427983.275011:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789427983.275025:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789427983.455379:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427983.455589:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789427983.455595:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789427983.465856:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789427983.465877:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789427983.466636:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427983.466832:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789427983.466837:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789427983.471580:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789427983.471597:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789427983.480525:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427983.481117:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789427983.481125:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789427983.481881:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789427983.481889:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789427983.485632:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427983.485847:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789427983.485855:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789427983.486918:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789427983.486929:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789427983.571832:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427983.572043:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789427983.572050:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789427983.584349:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789427983.584365:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789427983.589090:0:14350:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789427983.589107:0:14350:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789427983.596204:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789427983.596242:0:14350:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789427983.596248:0:14350:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789427983.596397:0:14350:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789427983.596437:0:14350:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.155@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789427983.596442:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789427983.596443:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789427983.596448:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427983.596450:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427983.596451:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427983.596452:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427983.596453:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427983.596454:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789427983.596456:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427983.596457:0:14350:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789427983.596460:0:14350:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789427983.596462:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789427983.596463:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789427983.596464:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427983.596465:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427983.596466:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427983.596467:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427983.596468:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427983.596468:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789427983.596470:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427983.596470:0:14350:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789427983.596495:0:14350:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789427983.596515:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e217100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129216:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789427983.596597:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427983.596652:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427983.596917:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877129216 00000100:00100000:2.0:1789427983.596924:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877129216 00000100:00100000:2.0:1789427983.596978:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789427983.596987:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+5:14350:x1876350877129216:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789427983.597040:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789427983.597043:0:14363:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789427983.597046:0:14363:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789427983.597821:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789427983.598224:0:14363:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789427983.599623:0:14385:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789427983.599630:0:14385:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789427983.599633:0:14385:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789427983.599669:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789427983.601934:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789427983.601947:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789427983.609166:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+5:14350:x1876350877129216:12345-0@lo:253:mount.lustre.0 Request processed in 12167us (12555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427983.609224:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789427983.609501:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e217100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129216:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789427983.609522:0:14350:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789427983.609527:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789427983.609528:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789427983.609530:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427983.609532:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427983.609533:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427983.609535:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427983.609537:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427983.609539:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789427983.609541:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427983.609542:0:14350:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789427983.609617:0:14350:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9333031bc000 from lustre-MDT0000 10000000:01000000:1.0:1789427983.609723:0:14350:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789427983.609745:0:14350:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789427983.609751:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93341deb4d40 10000000:01000000:1.0:1789427983.609755:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789427983.609766:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93341deb4d40 from 1 10000000:01000000:1.0:1789427983.609778:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789427983.609831:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427983.609844:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427983.609856:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427983.609879:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e217100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789427983.610037:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427983.610084:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427983.610373:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877129344 00000100:00100000:2.0:1789427983.610382:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877129344 00000100:00100000:2.0:1789427983.610435:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427983.610445:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+5:14350:x1876350877129344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789427983.610461:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427983.610480:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93340e1d5600/0x2bea1a57ca34432f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344328 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427983.610510:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93340e1d5600/0x2bea1a57ca34432f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344328 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427983.610523:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93340e1d5600/0x2bea1a57ca34432f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344328 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427983.610535:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5600, rc 0) 00000100:00100000:2.0:1789427983.610588:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+6:14350:x1876350877129344:12345-0@lo:101:mount.lustre.0 Request processed in 145us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427983.610595:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789427983.610790:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e217100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789427983.610806:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.610815:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427983.610876:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789427983.610906:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.611037:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c3780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789427983.611094:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877129472 00000100:00100000:2.0:1789427983.611099:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877129472 00000100:00100000:2.0:1789427983.611134:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789427983.611141:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+6:14350:x1876350877129472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789427983.611464:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+6:14350:x1876350877129472:12345-0@lo:501:mount.lustre.0 Request processed in 323us (556us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789427983.611471:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789427983.611884:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129472:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789427983.611915:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789427983.611943:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.611953:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427983.611963:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9333031bc000 10000000:01000000:0.0:1789427983.611968:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789427983.611973:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9333031bc000 10000000:01000000:0.0:1789427983.611975:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789427983.611978:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9333031bc000 from 1 10000000:01000000:0.0:1789427983.611981:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789427983.612007:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e179a00/0x2bea1a57ca344336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.612022:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e179a00/0x2bea1a57ca344336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.612033:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e179a00/0x2bea1a57ca344336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427983.612048:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789427983.612079:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.612109:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c3780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427983.612250:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877129600 00000100:00100000:3.0:1789427983.612266:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877129600 00000100:00100000:3.0:1789427983.612305:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789427983.612313:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+6:14350:x1876350877129600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789427983.612322:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427983.612336:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400030000/0x2bea1a57ca34433d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344336 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.612354:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030000/0x2bea1a57ca34433d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344336 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.612363:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400030000/0x2bea1a57ca34433d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344336 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.612370:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030000, rc 0) 00000100:00100000:3.0:1789427983.612403:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+7:14350:x1876350877129600:12345-0@lo:101:mount.lustre.0 Request processed in 91us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427983.612409:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789427983.612784:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789427983.612799:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e179a00/0x2bea1a57ca344336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34433d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.612808:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e179a00/0x2bea1a57ca344336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34433d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427983.612820:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789427983.612872:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e179a00/0x2bea1a57ca344336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34433d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.612880:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e179a00/0x2bea1a57ca344336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34433d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427983.612886:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789427983.612890:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789427983.612895:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9333031bc000 10000000:01000000:0.0:1789427983.612898:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789427983.612909:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789427983.612911:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789427983.612938:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e179200/0x2bea1a57ca344344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.612946:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e179200/0x2bea1a57ca344344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.612953:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e179200/0x2bea1a57ca344344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427983.612967:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789427983.613000:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.613029:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c3780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789427983.614742:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877129728 00000100:00100000:3.0:1789427983.614759:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877129728 00000100:00100000:3.0:1789427983.614832:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789427983.614842:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+7:14350:x1876350877129728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789427983.614860:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427983.614879:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400030a00/0x2bea1a57ca34434b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344344 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.614906:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030a00/0x2bea1a57ca34434b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344344 expref: 8 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.614917:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400030a00/0x2bea1a57ca34434b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344344 expref: 8 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.614948:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030a00, rc 0) 00000100:00100000:3.0:1789427983.615039:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+8:14350:x1876350877129728:12345-0@lo:101:mount.lustre.0 Request processed in 197us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427983.615046:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789427983.615507:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789427983.615530:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e179200/0x2bea1a57ca344344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34434b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427983.615540:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e179200/0x2bea1a57ca344344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34434b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427983.615654:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789427983.615698:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427983.615744:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427983.615968:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877129856 00000100:00100000:0.0:1789427983.615975:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877129856 00000100:00100000:0.0:1789427983.616016:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789427983.616024:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+8:14350:x1876350877129856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789427983.616557:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+9:14350:x1876350877129856:12345-0@lo:501:mount.lustre.0 Request processed in 532us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427983.616577:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789427983.617742:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789427983.617816:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789427983.617892:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427983.617943:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427983.618193:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877129984 00000100:00100000:0.0:1789427983.618201:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877129984 00000100:00100000:0.0:1789427983.618246:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789427983.618265:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+9:14350:x1876350877129984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789427983.619497:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+9:14350:x1876350877129984:12345-0@lo:503:mount.lustre.0 Request processed in 1237us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427983.619505:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789427983.619750:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877129984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789427983.621170:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14386:1876350877130112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427983.621516:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427983.621606:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c378780 going to sleep for 11 seconds 00000100:00100000:3.0:1789427983.621756:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877130112 00000100:00100000:3.0:1789427983.621766:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877130112 00000100:00100000:3.0:1789427983.621864:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789427983.621875:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+9:14386:x1876350877130112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789427983.622360:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+9:14386:x1876350877130112:12345-0@lo:502:llog_process_th.0 Request processed in 486us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427983.622369:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789427983.622647:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14386:1876350877130112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427983.622682:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427983.622696:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427983.622699:0:14386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789427983.622706:0:14386:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789427983.622709:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789427983.622727:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff933420f33380) 00000020:00000080:2.0:1789427983.622751:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789427983.622757:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789427983.622875:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789427983.622888:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca344359 00000020:00000080:2.0:1789427983.623137:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789427983.623143:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427983.623147:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427983.623149:0:14386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789427983.623152:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789427983.623156:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427983.623158:0:14386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789427983.623161:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789427983.623170:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff933420f30000) 00000020:00000080:2.0:1789427983.623221:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789427983.623227:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789427983.623229:0:14386:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789427983.623232:0:14386:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789427983.623245:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789427983.623304:0:14386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9333031bc000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789427983.623321:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff933420f34d40) 00000020:00000080:2.0:1789427983.623328:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789427983.623388:0:14386:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789427983.623395:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca34436e 00000020:00000080:2.0:1789427983.623496:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789427983.623504:0:14386:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789427983.623508:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2bea1a57ca344375 00080000:01000000:2.0:1789427983.623512:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789427983.623514:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca34437c 00010000:00010000:0.0:1789427983.806473:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789427983.809119:0:14386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1789427983.811241:0:14386:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789427983.811792:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93341deb3380) 00000020:00000080:0.0:1789427983.811812:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789427983.818717:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789427983.818735:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca34438a 00000020:00000080:0.0:1789427983.825985:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789427983.842190:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2bea1a57ca344391 00000020:00000080:1.0:1789427983.843468:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789427983.843483:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427983.843492:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427983.843494:0:14386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789427983.843498:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427983.843504:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427983.843506:0:14386:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789427983.843510:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789427983.843558:0:14386:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789427983.843581:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427983.843585:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427983.843587:0:14386:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789427983.843589:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789427983.843591:0:14386:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789427983.843593:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789427983.843594:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789427983.843595:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789427983.843597:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427983.843599:0:14386:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789427983.843601:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789427983.843604:0:14386:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789427983.843607:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427983.843609:0:14386:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789427983.843612:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789427983.843617:0:14386:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.155@tcp to nid 0x20000c0a8c99b (192.168.201.155@tcp) 00000020:01000000:1.0:1789427983.843648:0:14386:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789427983.843651:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789427983.843678:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93340614cd40) 00000020:00000080:1.0:1789427983.843696:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789427983.843703:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789427983.843772:0:14386:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789427983.843778:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789427983.843785:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca34439f 00010000:00080000:1.0:1789427983.843818:0:14386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933433d9e000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.155@tcp at head 00010000:00010000:1.0:1789427983.845260:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789427983.845680:0:14386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789427983.845722:0:14386:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789427983.854855:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789427983.854952:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789427983.855047:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789427983.860984:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789427983.860997:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789427983.871219:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789427983.871242:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789427983.871315:0:14386:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789427983.871342:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca3443a6 00000100:00080000:0.0:1789427983.871356:0:14386:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789427983.871371:0:14386:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff933433d9e000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789427983.871423:0:14386:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343f996300 x1876350877130240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789427983.871453:0:14386:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789427983.871532:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427983.871537:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427983.871540:0:14386:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789427983.871543:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789427983.871546:0:14386:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789427983.871548:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789427983.871550:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789427983.871552:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789427983.871554:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427983.871590:0:14386:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789427983.871594:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789427983.871599:0:14386:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789427983.871603:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427983.871604:0:14386:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789427983.871607:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789427983.871612:0:14386:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.155@tcp to nid 0x20000c0a8c99b (192.168.201.155@tcp) 00000020:01000000:0.0:1789427983.871650:0:14386:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789427983.871653:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789427983.871669:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93341deb0000) 00000020:00000080:0.0:1789427983.871684:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789427983.871688:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789427983.871771:0:14386:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789427983.871778:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789427983.871785:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bea1a57ca3443b4 00010000:00080000:0.0:1789427983.871829:0:14386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9334089bb000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.155@tcp at head 00010000:00010000:0.0:1789427983.872050:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789427983.872346:0:14386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789427983.872375:0:14386:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789427983.873116:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789427983.873211:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789427983.873302:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1789427983.874311:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877130240:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789427983.874427:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350877130240 offset 0 length 520: 4 00000040:00080000:0.0:1789427983.881000:0:14392:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789427983.881011:0:14392:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789427983.881978:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789427983.881996:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789427983.882038:0:14386:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789427983.882064:0:14386:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca3443bb 00000100:00080000:1.0:1789427983.882078:0:14386:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789427983.882092:0:14386:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9334089bb000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:1.0:1789427983.882142:0:14386:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93341e214e00 x1876350877130368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789427983.882339:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877130368:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789427983.882407:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350877130368 offset 0 length 520: 4 00000100:00080000:1.0:1789427983.882493:0:14386:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789427983.882560:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427983.882572:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427983.882575:0:14386:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789427983.882578:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427983.882583:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427983.882584:0:14386:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789427983.882587:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789427983.882589:0:14386:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789427983.882591:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427983.882603:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427983.882605:0:14386:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789427983.882608:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427983.882610:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427983.882611:0:14386:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789427983.882615:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789427983.882713:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14386:1876350877130496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427983.882885:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427983.882911:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c307d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427983.884050:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877130496 00000100:00100000:1.0:1789427983.884067:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877130496 00000100:00100000:1.0:1789427983.884257:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789427983.884282:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+9:14386:x1876350877130496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427983.885504:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+9:14386:x1876350877130496:12345-0@lo:502:llog_process_th.0 Request processed in 1228us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427983.885519:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789427983.891020:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14386:1876350877130496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789427983.891092:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789427983.891108:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789427983.891111:0:14386:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789427983.891118:0:14386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789427983.893517:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789427983.894033:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789427983.894111:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e179200/0x2bea1a57ca344344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34434b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.894129:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e179200/0x2bea1a57ca344344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34434b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427983.894223:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9333031bc000 from 1 10000000:01000000:3.0:1789427983.894227:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789427983.894305:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.894340:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.894355:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427983.894389:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877130624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789427983.894490:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427983.894550:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410cfdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789427983.895128:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877130624 00000100:00100000:1.0:1789427983.895140:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877130624 00000100:00100000:1.0:1789427983.895226:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789427983.895238:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+9:14350:x1876350877130624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789427983.895258:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427983.895293:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3443c2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427983.895325:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3443c2 expref: 10 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427983.895338:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3443c2 expref: 10 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427983.895364:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701600, rc 0) 00000100:00100000:1.0:1789427983.895436:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+10:14350:x1876350877130624:12345-0@lo:101:mount.lustre.0 Request processed in 199us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427983.895444:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789427983.895597:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877130624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789427983.895618:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.895651:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427983.896496:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877130752:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789427983.896703:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.896750:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053bac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427983.896946:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877130752 00000100:00100000:3.0:1789427983.896955:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877130752 00000100:00100000:3.0:1789427983.897005:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789427983.897015:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+10:14350:x1876350877130752:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789427983.897036:0:14361:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789427983.897044:0:14361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789427983.897122:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+10:14350:x1876350877130752:12345-0@lo:256:mount.lustre.0 Request processed in 109us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427983.897130:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789427983.897282:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877130752:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789427983.899516:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789427983.899954:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.899973:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427983.899985:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333031bc000 from 1 10000000:01000000:0.0:1789427983.899988:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789427983.900048:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.900056:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.900068:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427983.900096:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877130880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789427983.900411:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.900534:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053bac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427983.900588:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877130880 00000100:00100000:3.0:1789427983.900598:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877130880 00000100:00100000:3.0:1789427983.900730:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789427983.900740:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+10:14350:x1876350877130880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789427983.900757:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427983.901149:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3443d0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.901407:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3443d0 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.901435:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3443d0 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.901446:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400031000, rc 0) 00000100:00100000:2.0:1789427983.901866:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14350:x1876350877130880:12345-0@lo:101:mount.lustre.0 Request processed in 1124us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427983.901876:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789427983.903915:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877130880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789427983.903948:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427983.903960:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427983.904052:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789427983.904108:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.904166:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427983.904900:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877131008 00000100:00100000:1.0:1789427983.904913:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877131008 00000100:00100000:1.0:1789427983.904980:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789427983.904991:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14350:x1876350877131008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789427983.907068:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14350:x1876350877131008:12345-0@lo:501:mount.lustre.0 Request processed in 2069us (2949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427983.907082:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789427983.907280:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789427983.907352:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789427983.907420:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.907461:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053bac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427983.907511:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877131136 00000100:00100000:2.0:1789427983.907518:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877131136 00000100:00100000:2.0:1789427983.907563:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789427983.907573:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14350:x1876350877131136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789427983.907884:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14350:x1876350877131136:12345-0@lo:503:mount.lustre.0 Request processed in 312us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427983.907889:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789427983.907994:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789427983.911241:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14394:1876350877131264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427983.912432:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.912485:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789427983.912590:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877131264 00000100:00100000:1.0:1789427983.912602:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877131264 00000100:00100000:1.0:1789427983.912738:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789427983.912747:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14394:x1876350877131264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789427983.913170:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14394:x1876350877131264:12345-0@lo:502:llog_process_th.0 Request processed in 423us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427983.913205:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789427983.913338:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14394:1876350877131264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427983.913382:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427983.913396:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427983.913398:0:14394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789427983.913405:0:14394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9333031bc000 00000020:00000080:0.0:1789427983.913407:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789427983.913415:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427983.913417:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427983.913418:0:14394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789427983.913425:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427983.913427:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427983.913428:0:14394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789427983.913431:0:14394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9333031bc000 00000020:00000080:0.0:1789427983.913432:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789427983.913498:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427983.913500:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427983.913501:0:14394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789427983.913502:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427983.913504:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427983.913505:0:14394:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789427983.913507:0:14394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9333031bc000 00000020:00000080:0.0:1789427983.913508:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789427983.913552:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14394:1876350877131392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427983.913603:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427983.914838:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877131392 00000100:00100000:2.0:1789427983.914850:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877131392 00000100:00100000:2.0:1789427983.914899:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789427983.914907:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14394:x1876350877131392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427983.915228:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14394:x1876350877131392:12345-0@lo:502:llog_process_th.0 Request processed in 321us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427983.915234:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789427983.915429:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053bac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789427983.915452:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14394:1876350877131392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789427983.915481:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427983.915488:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427983.915490:0:14394:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789427983.915494:0:14394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789427983.917054:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789427983.917086:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789427983.917105:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427983.917118:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427983.917193:0:14350:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789427983.917196:0:14350:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9333031bc000 10000000:01000000:2.0:1789427983.917199:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9333031bc000 10000000:01000000:2.0:1789427983.917202:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789427983.917207:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9333031bc000 from 1 10000000:01000000:2.0:1789427983.917210:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789427983.917250:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93340e1d5200/0x2bea1a57ca3443de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427983.917257:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93340e1d5200/0x2bea1a57ca3443de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427983.917280:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93340e1d5200/0x2bea1a57ca3443de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427983.917309:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789427983.917392:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427983.917439:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433db0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427983.917474:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877131520 00000100:00100000:2.0:1789427983.917482:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877131520 00000100:00100000:2.0:1789427983.917525:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789427983.917534:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14350:x1876350877131520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789427983.917547:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427983.917561:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93340e1d5400/0x2bea1a57ca3443e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3443de expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427983.917598:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93340e1d5400/0x2bea1a57ca3443e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3443de expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427983.917609:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93340e1d5400/0x2bea1a57ca3443e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3443de expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427983.917618:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5400, rc 0) 00000100:00100000:2.0:1789427983.919901:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14350:x1876350877131520:12345-0@lo:101:mount.lustre.0 Request processed in 2350us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427983.919919:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789427983.927750:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789427983.927793:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93340e1d5200/0x2bea1a57ca3443de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3443e5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427983.927811:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93340e1d5200/0x2bea1a57ca3443de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3443e5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427983.938866:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789427983.938974:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.939030:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67780 going to sleep for 11 seconds 00000100:00100000:0.0:1789427983.941504:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877131648 00000100:00100000:0.0:1789427983.941529:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877131648 00000100:00100000:0.0:1789427983.941619:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789427983.941633:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14350:x1876350877131648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789427983.942050:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14350:x1876350877131648:12345-0@lo:501:mount.lustre.0 Request processed in 419us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427983.942067:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789427983.942152:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789427983.942249:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789427983.942317:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.942368:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67780 going to sleep for 11 seconds 00000100:00100000:2.0:1789427983.943447:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877131776 00000100:00100000:2.0:1789427983.943460:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877131776 00000100:00100000:2.0:1789427983.949942:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789427983.950261:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14350:x1876350877131776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789427983.950788:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14350:x1876350877131776:12345-0@lo:503:mount.lustre.0 Request processed in 539us (8471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427983.951041:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877131776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789427983.962390:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789427983.969137:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14399:1876350877131904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789427983.969313:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427983.970640:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67780 going to sleep for 11 seconds 00000100:00100000:3.0:1789427983.975732:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877131904 00000100:00100000:3.0:1789427983.975757:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877131904 00000100:00100000:2.0:1789427983.975940:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789427983.975954:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14399:x1876350877131904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427983.976455:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14399:x1876350877131904:12345-0@lo:502:llog_process_th.0 Request processed in 501us (7141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427983.976473:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789427983.978359:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14399:1876350877131904:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789427983.978474:0:14399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789427983.978499:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9334061499c0) 00000020:00000080:1.0:1789427983.978523:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789427983.978680:0:14399:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9333031bc000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789427983.978694:0:14399:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9333031bc000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789427983.978697:0:14399:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9333031bc000 4 00010000:00080000:1.0:1789427983.978734:0:14399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93340f105000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.155@tcp at head 00010000:00010000:2.0:1789427983.997316:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789427983.998154:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789427983.998224:0:14399:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789427983.998241:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2bea1a57ca3443f3 00000100:00080000:2.0:1789427983.998255:0:14399:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789427983.998284:0:14399:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93340f105000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:2.0:1789427984.000118:0:14399:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93330387ca80 x1876350877132032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789427984.000168:0:14399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789427984.000594:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877132032:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789427984.000686:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427984.001471:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877132032 00000100:00100000:2.0:1789427984.001491:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877132032 00000100:00100000:2.0:1789427984.001547:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427984.001558:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876350877132032:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789427984.004257:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876350877132032:12345-0@lo:38:llog_process_th.0 Request processed in 2686us (3558us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789427984.004288:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427984.004489:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14399:1876350877132160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427984.004562:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427984.004605:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877132160 00000100:00100000:2.0:1789427984.004612:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877132160 00000100:00100000:2.0:1789427984.004655:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789427984.004663:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14399:x1876350877132160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789427984.005007:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14399:x1876350877132160:12345-0@lo:502:llog_process_th.0 Request processed in 342us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427984.005015:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789427984.005085:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433db0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789427984.005111:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:92161c2e-b691-4539-8b6b-a6d322602ab0:14399:1876350877132160:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789427984.005139:0:14399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789427984.006468:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789427984.006503:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789427984.006530:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93340e1d5200/0x2bea1a57ca3443de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3443e5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427984.006546:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93340e1d5200/0x2bea1a57ca3443de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3443e5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789427984.006621:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789427984.006623:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789427984.006625:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427984.006626:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427984.006628:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427984.006629:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427984.006631:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789427984.006633:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789427984.006634:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427984.006636:0:14350:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427984.006640:0:14350:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789427984.006643:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789427984.006650:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789427984.006651:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789427984.006652:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789427984.006653:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789427984.006654:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789427984.006655:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789427984.006656:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789427984.006657:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789427984.006658:0:14350:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789427984.006689:0:14350:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789427984.006709:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877132288:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789427984.006794:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427984.007131:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b67c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789427984.008011:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877132288 00000100:00100000:2.0:1789427984.008025:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877132288 00000100:00100000:2.0:1789427984.008102:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789427984.008115:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14350:x1876350877132288:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789427984.008165:0:14363:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789427984.008201:0:14363:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789427984.008898:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789427984.008913:0:3297:0:(import.c:65:import_set_state_nolock()) ffff93340f105000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789427984.008921:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789427984.008926:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877132032:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1789427984.105079:0:14363:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789427984.105110:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789427984.105389:0:14384:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789427984.105396:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789427984.105424:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427984.105449:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3443c2 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427984.105458:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427984.105510:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3443c2 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427984.105529:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3443c2 expref: 12 pid: 14363 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427984.105566:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1876350877132416:0@lo:104: 00000100:00100000:3.0:1789427984.105657:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427984.105728:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410cfd180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427984.105843:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877132416 00000100:00100000:1.0:1789427984.105853:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877132416 00000100:00100000:1.0:1789427984.105927:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427984.105940:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+3:14384:x1876350877132416:12345-0@lo:104: 00010000:00010000:1.0:1789427984.105968:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106049:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427984.106057:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+3:14384:x1876350877132416:12345-0@lo:104: Request processed in 120us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427984.106066:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789427984.106095:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789427984.106103:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106111:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400030200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:1.0:1789427984.106116:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106137:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789427984.106147:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789427984.106154:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789427984.106231:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106240:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789427984.106280:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106289:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400030200/0x2bea1a57ca3443c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3443c9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106315:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427984.106317:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789427984.106319:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789427984.106348:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:92161c2e-b691-4539-8b6b-a6d322602ab0:3301:1876350877132544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789427984.106382:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427984.106455:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877132544 00000100:00100000:1.0:1789427984.106460:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877132544 00010000:00010000:1.0:1789427984.106479:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3443c2 expref: 13 pid: 14363 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427984.106508:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789427984.106517:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+13:3301:x1876350877132544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789427984.106536:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789427984.106542:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3443c2 expref: 13 pid: 14363 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106554:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3443c2 expref: 13 pid: 14363 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106573:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106582:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789427984.106597:0:14353:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001202646s 00010000:00010000:1.0:1789427984.106602:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106610:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106617:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106624:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106629:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789427984.106633:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106642:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106659:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.106670:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789427984.106710:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+13:3301:x1876350877132544:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427984.106717:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427984.106780:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:92161c2e-b691-4539-8b6b-a6d322602ab0:3301:1876350877132544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427984.107257:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933420701600/0x2bea1a57ca3443c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3443c2 expref: 12 pid: 14363 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427984.107281:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1876350877132416:0@lo:104: 00010000:00010000:3.0:1789427984.107300:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427984.107312:0:14384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427984.107319:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427984.107327:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400031e00/0x2bea1a57ca3443fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427984.130919:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14350:x1876350877132288:12345-0@lo:253:mount.lustre.0 Request processed in 122785us (124103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427984.130939:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789427984.131301:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:14350:1876350877132288:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789427984.131322:0:14350:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789427984.131326:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789427984.131329:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789427984.131330:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427984.131332:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427984.131333:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427984.131335:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427984.131336:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789427984.131338:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789427984.131340:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427984.131341:0:14350:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789427984.131364:0:14350:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789427984.140070:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427984.141130:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427984.141600:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427984.141986:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427984.142362:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427984.142542:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427984.143802:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427984.143932:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427984.144643:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427984.144904:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789427984.145172:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789427984.145386:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:3.0:1789427984.201438:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789427984.212665:0:14350:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000020:00080000:2.0:1789427984.213572:0:14408:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000040:01000000:1.0:1789427984.213573:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789427984.213577:0:14408:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1789427984.215490:0:14409:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1789427984.215660:0:14409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789427984.217689:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789427984.217753:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:1.0:1789427984.217821:0:14350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789427984.217829:0:14409:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789427984.217833:0:14409:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1789427984.218317:0:14350:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789427984.218327:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789427984.218472:0:14350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789427984.220328:0:14350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789427984.220902:0:14350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789427984.220960:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789427984.221842:0:14350:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1789427984.223312:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789427984.228668:0:14350:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789427984.272091:0:14350:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789427984.272150:0:14350:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9e6b41b83988 00100000:10000000:2.0:1789427984.272161:0:14350:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789427984.273622:0:14350:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789427984.273644:0:14350:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789427984.273662:0:14350:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789427984.273701:0:14350:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 10000000:01000000:2.0:1789427984.969235:0:14365:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789427984.969260:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9333031bc000 from 6 10000000:01000000:2.0:1789427984.969266:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789427984.969330:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427984.969344:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427984.969358:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427984.969392:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877132672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789427984.969485:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427984.969655:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341c307180 going to sleep for 11 seconds 00000100:00100000:0.0:1789427984.969726:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877132672 00000100:00100000:0.0:1789427984.969736:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877132672 00000100:00100000:0.0:1789427984.969823:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789427984.969834:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14365:x1876350877132672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427984.969850:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427984.969869:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344401 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427984.969896:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344401 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427984.969907:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344401 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427984.969917:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178e00, rc 0) 00000100:00100000:0.0:1789427984.969969:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14365:x1876350877132672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427984.969976:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789427984.970065:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877132672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427984.970084:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.970093:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427984.970153:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877132800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789427984.970210:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427984.971086:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341e1ad480 going to sleep for 11 seconds 00000100:00100000:2.0:1789427984.971161:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877132800 00000100:00100000:2.0:1789427984.971170:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877132800 00000100:00100000:2.0:1789427984.971240:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789427984.971257:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14365:x1876350877132800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789427984.971285:0:14361:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789427984.971317:0:14361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789427984.971320:0:14361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789427984.971424:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14365:x1876350877132800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427984.971433:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789427984.971674:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877132800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789427984.971735:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789427984.971746:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427984.971757:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789427985.033972:0:14400:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789427985.034005:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789427985.036874:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1789427985.036893:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789427985.227328:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789427986.060762:0:14400:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789427986.060771:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427986.061879:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789427986.061954:0:14400:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789427986.062332:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1789427986.252097:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427987.274522:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427988.297707:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789427988.616058:0:14652:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789427989.322048:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789427989.450444:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789427989.450451:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789427989.450465:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789427989.450467:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789427989.450470:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789427989.450473:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789427989.450476:0:8:0:(import.c:65:import_set_state_nolock()) ffff93340f105000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427989.450493:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93340f105000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:2.0:1789427989.450515:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93330387c700 x1876350877133056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427989.450569:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877132928:0@lo:400:kworker.0 00000100:00100000:2.0:1789427989.450646:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427989.451394:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877133056:0@lo:38:kworker.0 00000100:00100000:3.0:1789427989.451437:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427989.452696:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877132928 00000100:00100000:2.0:1789427989.452709:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877132928 00000100:00100000:2.0:1789427989.452759:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789427989.452768:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:3298:x1876350877132928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427989.452838:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:3298:x1876350877132928:12345-0@lo:400:kworker.0 Request processed in 71us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427989.452844:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789427989.453879:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877132928:0@lo:400:kworker.0 00000100:00100000:0.0:1789427989.454195:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877133056 00000100:00100000:0.0:1789427989.454203:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877133056 00000100:00100000:0.0:1789427989.454232:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427989.454238:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1876350877133056:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789427989.454278:0:14370:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1789427989.454313:0:14370:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2bea1a57ca34440f 00000004:00100000:0.0:1789427989.454328:0:14370:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789427989.454471:0:14370:0:(import.c:65:import_set_state_nolock()) ffff93341df76000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789427989.454538:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1876350877133056:12345-0@lo:38:kworker.0 Request processed in 298us (3099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427989.454544:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789427989.454585:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93330387c700 x1876350877133056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789427999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789427989.454715:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789427989.454724:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789427989.454729:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789427989.454731:0:3297:0:(import.c:65:import_set_state_nolock()) ffff93340f105000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789427989.454737:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1876350877133056:0@lo:38:kworker.0 00010000:00010000:1.0:1789427990.352338:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427991.370224:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789427991.680032:0:14803:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff916125a0 20000000:00000080:3.0:1789427991.680051:0:14803:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93340facc400 uarg=0000000000000000 20000000:01000000:3.0:1789427991.680083:0:14803:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789427991.680088:0:14803:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789427991.680092:0:14803:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789427991.683352:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789427991.683521:0:14803:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789427991.688958:0:14803:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789427991.688998:0:14803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.689018:0:14803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3443d0 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.689027:0:14803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.689071:0:14803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3443d0 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.689086:0:14803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3443d0 expref: 11 pid: 14361 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427991.689103:0:14803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14803:1876350877133184:0@lo:104: 00000100:00100000:3.0:1789427991.689313:0:14803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427991.689368:0:14803:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410cfdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789427991.689395:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877133184 00000100:00100000:0.0:1789427991.689405:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877133184 00000100:00100000:0.0:1789427991.689464:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789427991.689475:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:92161c2e-b691-4539-8b6b-a6d322602ab0+3:14803:x1876350877133184:12345-0@lo:104: 00010000:00010000:0.0:1789427991.689492:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427991.689558:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789427991.689565:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:92161c2e-b691-4539-8b6b-a6d322602ab0+3:14803:x1876350877133184:12345-0@lo:104: Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427991.689572:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427991.689588:0:14803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14803:1876350877133184:0@lo:104: 00010000:00010000:0.0:1789427991.689596:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789427991.689603:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.689607:0:14803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427991.689610:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178200 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:0.0:1789427991.689614:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427991.689622:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789427991.689629:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789427991.689635:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789427991.689671:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427991.689677:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789427991.689699:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427991.689705:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93341e178200/0x2bea1a57ca3443d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3443d7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427991.689734:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427991.689736:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789427991.689737:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427991.689749:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877133312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789427991.689793:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427991.689952:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877133312 00000100:00100000:3.0:1789427991.689957:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877133312 00010000:00010000:3.0:1789427991.689977:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3443d0 expref: 12 pid: 14361 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427991.690000:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427991.690006:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:3299:x1876350877133312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789427991.690017:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789427991.690022:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3443d0 expref: 12 pid: 14361 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690032:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3443d0 expref: 12 pid: 14361 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690044:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400031000/0x2bea1a57ca3443d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3443d0 expref: 12 pid: 14361 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690058:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690066:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690078:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690092:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690099:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690106:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690111:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789427991.690115:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690122:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690157:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427991.690166:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789427991.690223:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+11:3299:x1876350877133312:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427991.690230:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427991.690259:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877133312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789427991.690325:0:14803:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427991.690333:0:14803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427991.690339:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400031e00/0x2bea1a57ca344416 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427992.394853:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789427993.417538:0:14365:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789427993.417546:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333031bc000 from 10 10000000:01000000:3.0:1789427993.417552:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789427993.417602:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427993.417630:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427993.417644:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427993.417676:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877133440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789427993.417758:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427993.417811:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410cfd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789427993.417871:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877133440 00000100:00100000:0.0:1789427993.417878:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877133440 00000100:00100000:0.0:1789427993.417932:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789427993.417941:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+11:14365:x1876350877133440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789427993.417955:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427993.417968:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34441d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427993.417991:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34441d expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427993.418002:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34441d expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427993.418021:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179400, rc 0) 00000100:00100000:0.0:1789427993.418071:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14365:x1876350877133440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427993.418086:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789427993.418205:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877133440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789427993.418220:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427993.418230:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427993.418300:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877133568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427993.418328:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427993.418354:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334202710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427993.418456:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877133568 00000100:00100000:0.0:1789427993.418461:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877133568 00000100:00100000:0.0:1789427993.418492:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789427993.418498:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14365:x1876350877133568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789427993.418744:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14365:x1876350877133568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427993.418751:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789427993.418824:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877133568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789427993.418851:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877133696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789427993.418889:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427993.418910:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334202710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427993.418948:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877133696 00000100:00100000:0.0:1789427993.418952:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877133696 00000100:00100000:0.0:1789427993.418980:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789427993.418986:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14365:x1876350877133696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789427993.419135:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:14365:x1876350877133696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427993.419143:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789427993.419241:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877133696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789427993.420128:0:14875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789427993.420563:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789427993.420584:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789427993.420592:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427993.420603:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427993.421362:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789427993.545413:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789427983/real 1789427983] req@ffff93341e214e00 x1876350877130368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789427993 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427993.545451:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93341e214e00 x1876350877130368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789427993 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427993.545463:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789427983/real 1789427983] req@ffff93343f996300 x1876350877130240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789427993 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427993.545477:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93343f996300 x1876350877130240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789427993 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789427993.545497:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9334089bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789427993.545516:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789427993.545519:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877130368:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789427993.545523:0:3297:0:(import.c:65:import_set_state_nolock()) ffff933433d9e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789427993.545527:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789427993.545529:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877130240:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789427993.546360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789427993.546368:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789427993.546372:0:36:0:(import.c:65:import_set_state_nolock()) ffff933433d9e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427993.546378:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1789427993.546384:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789427993.546399:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff933433d9e000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:2.0:1789427993.546441:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93330387dc00 x1876350877133824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789427993.546469:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789427993.546473:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789427993.546475:0:36:0:(import.c:65:import_set_state_nolock()) ffff9334089bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789427993.546478:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1789427993.546481:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789427993.546487:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9334089bb000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:2.0:1789427993.546501:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93330387c000 x1876350877133952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789427993.546556:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789427993.546571:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877134080:0@lo:400:kworker.0 00000100:00100000:2.0:1789427993.546733:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427993.546820:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877134080 00000100:00100000:2.0:1789427993.546829:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877134080 00000100:00100000:2.0:1789427993.546884:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789427993.546892:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877134080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789427993.546951:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877134080:12345-0@lo:400:kworker.0 Request processed in 59us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427993.546958:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789427993.546998:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93330387e680 x1876350877134080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789427993.547010:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877134080:0@lo:400:kworker.0 00000100:00100000:0.0:1789427993.547213:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877133824:0@lo:8:kworker.0 00000400:00000100:0.0:1789427993.547245:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350877133824 offset 0 length 520: 4 00000100:00100000:0.0:1789427993.547265:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877133952:0@lo:8:kworker.0 00000400:00000100:0.0:1789427993.547365:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350877133952 offset 0 length 520: 4 00010000:00010000:1.0:1789427994.442324:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427995.466297:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789427996.297832:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1789427996.324009:0:15053:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789427996.324014:0:15053:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789427996.324166:0:15053:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff933406aea800 00000020:01000004:3.0:1789427996.324232:0:15053:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789427996.324247:0:15053:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789427996.324262:0:15053:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff933410134d40) 00000020:00000080:3.0:1789427996.324285:0:15053:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789427996.352604:0:15053:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789427996.353171:0:15053:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789427996.354670:0:15053:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789427996.357650:0:15053:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789427996.359203:0:15053:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789427996.362216:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 337: rc = 0 00100000:10000000:3.0:1789427996.363285:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 337: rc = 0 00100000:10000000:3.0:1789427996.363383:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 337: rc = 0 00100000:10000000:3.0:1789427996.363772:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1789427996.368716:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1789427996.369075:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1789427996.369454:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1789427996.369714:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1789427996.369980:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:2.0:1789427996.370747:0:15053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789427996.370763:0:15053:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789427996.370778:0:15053:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bea1a57ca344432 00000020:01000004:2.0:1789427996.370788:0:15053:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789427996.370817:0:15053:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789427996.370821:0:15053:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789427996.370827:0:15053:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789427996.370833:0:15053:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789427996.370848:0:15053:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff933420f319c0) 00000020:00000080:2.0:1789427996.370859:0:15053:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789427996.373794:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427996.374629:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789427996.374638:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789427996.375812:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789427996.375822:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789427996.384332:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789427996.384346:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789427996.391682:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427996.392435:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789427996.392446:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789427996.393699:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789427996.393713:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789427996.437745:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789427996.438849:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789427996.438875:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789427996.441637:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789427996.441653:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789427996.450204:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789427996.450220:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789427996.453474:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789427996.453661:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789427996.453666:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789427996.457618:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789427996.457630:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1789427996.490820:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789427996.509857:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789427996.510401:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789427996.510409:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789427996.517029:0:15053:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789427996.517166:0:15053:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789427996.520694:0:15053:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789427996.520718:0:15053:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789427996.520724:0:15053:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789427996.533806:0:15053:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789427996.533856:0:15053:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.155@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789427996.533865:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789427996.533867:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789427996.533868:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789427996.533870:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789427996.533871:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789427996.533872:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789427996.533873:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789427996.533875:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789427996.533876:0:15053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789427996.533880:0:15053:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789427996.533882:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789427996.533883:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789427996.533884:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789427996.533885:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789427996.533886:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789427996.533886:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789427996.533887:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789427996.533888:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789427996.533889:0:15053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789427996.533969:0:15053:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789427996.533991:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789427996.534067:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427996.534222:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789427996.535560:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877134208 00000100:00100000:0.0:1789427996.535574:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877134208 00000100:00100000:0.0:1789427996.535642:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789427996.535652:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:15053:x1876350877134208:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789427996.535729:0:14362:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789427996.535733:0:14362:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789427996.535737:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789427996.558019:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:15053:x1876350877134208:12345-0@lo:253:mount.lustre.0 Request processed in 22359us (23942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427996.558034:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789427996.558220:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134208:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789427996.558238:0:15053:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789427996.558242:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789427996.558244:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789427996.558245:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789427996.558246:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789427996.558248:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789427996.558249:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789427996.558251:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789427996.558253:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789427996.558254:0:15053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789427996.558278:0:15053:0:(tgt_mount.c:101:server_register_mount()) register mount ffff933406aea800 from lustre-OST0000 10000000:01000000:2.0:1789427996.558306:0:15053:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789427996.558308:0:15053:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789427996.558341:0:15053:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93341deb4d40 local copy 00010000:00010000:2.0:1789427996.558351:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427996.558599:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789427996.558633:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427996.558659:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789427996.559288:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877134336 00000100:00100000:1.0:1789427996.559295:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877134336 00000100:00100000:1.0:1789427996.559404:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789427996.559413:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:15053:x1876350877134336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789427996.560015:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+12:15053:x1876350877134336:12345-0@lo:501:mount.lustre.0 Request processed in 603us (1380us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789427996.560023:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789427996.560267:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134336:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789427996.560295:0:15053:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789427996.560633:0:15053:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789427996.560641:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.560653:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427996.560677:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933406aea800 10000000:01000000:3.0:1789427996.560682:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789427996.560687:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93341deb4d40 10000000:01000000:3.0:1789427996.560690:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789427996.560693:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93341deb4d40 from 1 10000000:01000000:3.0:1789427996.560696:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789427996.560725:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030400/0x2bea1a57ca344440 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.560734:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400030400/0x2bea1a57ca344440 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.560745:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400030400/0x2bea1a57ca344440 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427996.560764:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789427996.560802:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.560889:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334038aca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789427996.560980:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877134464 00000100:00100000:1.0:1789427996.560986:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877134464 00000100:00100000:1.0:1789427996.561192:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789427996.561202:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+12:15053:x1876350877134464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789427996.561214:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789427996.561228:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933420701a00/0x2bea1a57ca344447 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344440 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427996.561250:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933420701a00/0x2bea1a57ca344447 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344440 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427996.561261:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933420701a00/0x2bea1a57ca344447 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344440 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427996.561268:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701a00, rc 0) 00000100:00100000:1.0:1789427996.561313:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+13:15053:x1876350877134464:12345-0@lo:101:mount.lustre.0 Request processed in 113us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427996.561319:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789427996.561401:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789427996.561413:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400030400/0x2bea1a57ca344440 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344447 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.561431:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400030400/0x2bea1a57ca344440 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca344447 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427996.561447:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789427996.561463:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030400/0x2bea1a57ca344440 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344447 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.561470:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400030400/0x2bea1a57ca344440 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344447 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427996.561476:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789427996.561480:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789427996.561484:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789427996.561486:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789427996.561503:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031c00/0x2bea1a57ca34444e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.561511:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400031c00/0x2bea1a57ca34444e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.561519:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400031c00/0x2bea1a57ca34444e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427996.561532:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789427996.561571:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.561938:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334038aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789427996.562084:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877134592 00000100:00100000:2.0:1789427996.562090:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877134592 00000100:00100000:2.0:1789427996.562117:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789427996.562125:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+13:15053:x1876350877134592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789427996.562134:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427996.562145:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93340e1d5e00/0x2bea1a57ca344455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34444e expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.562161:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93340e1d5e00/0x2bea1a57ca344455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34444e expref: 14 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.562169:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93340e1d5e00/0x2bea1a57ca344455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34444e expref: 14 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.562250:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5e00, rc 0) 00000100:00100000:3.0:1789427996.562562:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877134592:12345-0@lo:101:mount.lustre.0 Request processed in 436us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427996.562581:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789427996.562704:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789427996.562719:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400031c00/0x2bea1a57ca34444e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344455 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.562729:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400031c00/0x2bea1a57ca34444e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca344455 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427996.565153:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789427996.566689:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427996.567004:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789427996.567061:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789427996.567098:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789427996.567148:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789427996.567227:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789427996.567264:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789427996.567402:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789427996.567411:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789427996.567498:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789427996.567711:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.567876:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d832780 going to sleep for 11 seconds 00000100:00100000:2.0:1789427996.568025:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877134720 00000100:00100000:2.0:1789427996.568033:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877134720 00000100:00100000:2.0:1789427996.568126:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789427996.568136:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877134720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789427996.568533:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877134720:12345-0@lo:501:mount.lustre.0 Request processed in 398us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427996.568553:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789427996.568716:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789427996.568769:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789427996.568813:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.569225:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d832780 going to sleep for 11 seconds 00000100:00100000:0.0:1789427996.569300:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877134848 00000100:00100000:0.0:1789427996.569307:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877134848 00000100:00100000:0.0:1789427996.569348:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789427996.569357:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877134848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789427996.569820:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877134848:12345-0@lo:503:mount.lustre.0 Request processed in 463us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427996.569827:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789427996.570032:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789427996.571118:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789427996.571450:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789427996.571513:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.571663:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420271180 going to sleep for 11 seconds 00000100:00100000:0.0:1789427996.571713:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877134976 00000100:00100000:0.0:1789427996.571719:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877134976 00000100:00100000:0.0:1789427996.571813:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789427996.571828:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877134976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789427996.572082:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877134976:12345-0@lo:502:mount.lustre.0 Request processed in 254us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427996.572090:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789427996.572203:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877134976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789427996.572473:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789427996.572525:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789427996.572582:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789427996.572636:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789427996.572668:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789427996.572698:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789427996.572741:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789427996.572776:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789427996.572810:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789427996.572864:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789427996.572905:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789427996.572952:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789427996.572985:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789427996.573032:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.573591:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420271180 going to sleep for 11 seconds 00000100:00100000:2.0:1789427996.573739:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877135104 00000100:00100000:2.0:1789427996.573746:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877135104 00000100:00100000:2.0:1789427996.573781:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789427996.573788:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877135104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789427996.574050:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877135104:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427996.574058:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789427996.574214:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789427996.574296:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789427996.574308:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789427996.575756:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789427996.575767:0:15067:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789427996.575774:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789427996.575777:0:15067:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789427996.575783:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789427996.575797:0:15067:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9334101319c0) 00000020:00000080:3.0:1789427996.575821:0:15067:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789427996.575828:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789427996.575974:0:15067:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933406aea800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789427996.575983:0:15067:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789427996.575994:0:15067:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bea1a57ca344463 00010000:00010000:3.0:1789427996.580413:0:15067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789427996.581019:0:15067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789427996.583448:0:15067:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789427996.585130:0:15067:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789427996.585143:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427996.585149:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427996.585152:0:15067:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789427996.585155:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789427996.585159:0:15067:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789427996.585166:0:15067:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789427996.585168:0:15067:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789427996.585170:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789427996.585202:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427996.585205:0:15067:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789427996.585208:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427996.585213:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427996.585214:0:15067:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789427996.585217:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789427996.585218:0:15067:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789427996.585220:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427996.585222:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427996.585223:0:15067:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789427996.585226:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789427996.585227:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427996.585229:0:15067:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789427996.585231:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789427996.585291:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789427996.585295:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789427996.585296:0:15067:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789427996.585300:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789427996.585658:0:15053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789427996.585689:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789427996.585713:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031c00/0x2bea1a57ca34444e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344455 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.585725:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400031c00/0x2bea1a57ca34444e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344455 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427996.585733:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933406aea800 from 1 10000000:01000000:3.0:1789427996.585735:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789427996.585770:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.585779:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.585790:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427996.585814:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789427996.585878:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.585982:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff93342229e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427996.586088:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877135232 00000100:00100000:2.0:1789427996.586097:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877135232 00000100:00100000:2.0:1789427996.586144:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789427996.586155:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+14:15053:x1876350877135232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789427996.586169:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789427996.586210:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34446a expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.586235:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34446a expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.586247:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34446a expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.586265:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5c00, rc 0) 00000100:00100000:2.0:1789427996.586311:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135232:12345-0@lo:101:mount.lustre.0 Request processed in 158us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427996.586318:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789427996.586622:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789427996.586639:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.586648:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427996.587511:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789427996.590378:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427996.590693:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789427996.590740:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789427996.590805:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789427996.590813:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789427996.590913:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789427996.590983:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.596674:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff93342229e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789427996.598662:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877135360 00000100:00100000:1.0:1789427996.598684:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877135360 00000100:00100000:1.0:1789427996.598796:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789427996.598810:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789427996.599203:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135360:12345-0@lo:501:mount.lustre.0 Request processed in 394us (8217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427996.599211:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789427996.599313:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789427996.599378:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789427996.599425:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.602259:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff93342229e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427996.602451:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877135488 00000100:00100000:2.0:1789427996.602461:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877135488 00000100:00100000:2.0:1789427996.602502:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789427996.602512:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789427996.602747:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135488:12345-0@lo:503:mount.lustre.0 Request processed in 236us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427996.602754:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789427996.603486:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135488:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789427996.604277:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789427996.604435:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789427996.604503:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427996.604657:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877135616 00000100:00100000:2.0:1789427996.604663:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877135616 00000100:00100000:2.0:1789427996.604702:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789427996.604711:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789427996.604887:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135616:12345-0@lo:502:mount.lustre.0 Request processed in 176us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427996.604895:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789427996.605033:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334038aca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789427996.605063:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789427996.605693:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789427996.605747:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789427996.605793:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789427996.605828:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789427996.605862:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789427996.608049:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789427996.608138:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789427996.608686:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789427996.608741:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789427996.608819:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.608868:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff93342229e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789427996.609447:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877135744 00000100:00100000:2.0:1789427996.609457:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877135744 00000100:00100000:2.0:1789427996.609508:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789427996.609517:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789427996.609817:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135744:12345-0@lo:502:mount.lustre.0 Request processed in 300us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427996.609824:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789427996.610495:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789427996.611105:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789427996.611121:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789427996.620738:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427996.620756:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427996.620759:0:15071:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789427996.620767:0:15071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933406aea800 00000020:00000080:0.0:1789427996.620769:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789427996.620777:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427996.620779:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427996.620781:0:15071:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789427996.620783:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427996.620786:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427996.620787:0:15071:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789427996.620790:0:15071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933406aea800 00000020:00000080:0.0:1789427996.620792:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789427996.620861:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427996.620865:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427996.620867:0:15071:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789427996.620869:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789427996.620872:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427996.620873:0:15071:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789427996.620876:0:15071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff933406aea800 00000020:00000080:0.0:1789427996.620879:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789427996.620924:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789427996.620928:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789427996.620929:0:15071:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789427996.620932:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789427996.621099:0:15053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789427996.621128:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789427996.621142:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.621155:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789427996.621231:0:15053:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789427996.621235:0:15053:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933406aea800 10000000:01000000:3.0:1789427996.621238:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933406aea800 10000000:01000000:3.0:1789427996.621242:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789427996.621248:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933406aea800 from 1 10000000:01000000:3.0:1789427996.621251:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789427996.621288:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca344478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.621297:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca344478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.621309:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca344478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427996.621346:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789427996.621409:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.621449:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff93342229e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789427996.621795:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877135872 00000100:00100000:0.0:1789427996.621804:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877135872 00000100:00100000:0.0:1789427996.621852:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789427996.621868:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877135872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789427996.621882:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789427996.621894:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e179000/0x2bea1a57ca34447f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344478 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427996.621929:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e179000/0x2bea1a57ca34447f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344478 expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427996.621940:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e179000/0x2bea1a57ca34447f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344478 expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427996.621948:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e179000, rc 0) 00000100:00100000:0.0:1789427996.621988:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877135872:12345-0@lo:101:mount.lustre.0 Request processed in 121us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427996.621995:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789427996.622140:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877135872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789427996.622155:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca344478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34447f expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427996.622164:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca344478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34447f expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789427996.622840:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789427996.623512:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789427996.628083:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789427996.628168:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789427996.636789:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789427996.636879:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789427996.636921:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789427996.636973:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789427996.637011:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789427996.637056:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789427996.637108:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789427996.637144:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789427996.642520:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789427996.642667:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789427996.646444:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789427996.646502:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789427996.646579:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789427996.646614:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789427996.646642:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789427996.646683:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789427996.646734:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789427996.646776:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789427996.646828:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789427996.647304:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789427996.647350:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789427996.647425:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789427996.647462:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789427996.647494:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789427996.647542:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789427996.647579:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789427996.647782:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789427996.647796:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789427996.647921:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789427996.648001:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427996.648057:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420271180 going to sleep for 11 seconds 00000100:00100000:1.0:1789427996.648088:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877136000 00000100:00100000:1.0:1789427996.648096:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877136000 00000100:00100000:1.0:1789427996.648153:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789427996.648163:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877136000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789427996.649069:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877136000:12345-0@lo:501:mount.lustre.0 Request processed in 903us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427996.649078:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789427996.649135:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789427996.649192:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789427996.649239:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427996.649266:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877136128 00000100:00100000:1.0:1789427996.649270:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877136128 00000100:00100000:0.0:1789427996.653131:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427996.653285:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789427996.653339:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877136128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789427996.655145:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877136128:12345-0@lo:503:mount.lustre.0 Request processed in 1838us (5896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427996.655160:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789427996.655253:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136128:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789427996.663800:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789427996.663913:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789427996.664005:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427996.664080:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e720c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789427996.664468:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877136256 00000100:00100000:0.0:1789427996.664476:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877136256 00000100:00100000:0.0:1789427996.664519:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789427996.664528:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877136256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789427996.669275:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877136256:12345-0@lo:502:mount.lustre.0 Request processed in 4739us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427996.669290:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789427996.669766:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789427996.670770:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789427996.670842:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789427996.671305:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789427996.671666:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789427996.671702:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789427996.671742:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789427996.671771:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789427996.671798:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789427996.671836:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789427996.671863:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789427996.672275:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789427996.672623:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789427996.672664:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789427996.672715:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789427996.672762:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789427996.672797:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789427996.672832:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789427996.672891:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789427996.673446:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789427996.673482:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789427996.673532:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789427996.674024:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789427996.674072:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789427996.674121:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789427996.674158:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789427996.674409:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789427996.674463:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789427996.674498:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789427996.674527:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789427996.677160:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789427996.677238:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789427996.677270:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789427996.677303:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789427996.677366:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789427996.677412:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789427996.677461:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789427996.677495:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789427996.677526:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789427996.677571:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789427996.677606:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789427996.679009:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789427996.679098:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427996.679146:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877136384 00000100:00100000:1.0:1789427996.679154:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877136384 00000100:00100000:1.0:1789427996.679237:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789427996.679247:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877136384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789427996.685267:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877136384:12345-0@lo:502:mount.lustre.0 Request processed in 6013us (6161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427996.685283:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789427996.685367:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427996.685392:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789427996.685505:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789427996.685519:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789427996.686389:0:15076:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789427996.686418:0:15076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff933301384d40) 00000020:00000080:0.0:1789427996.686439:0:15076:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789427996.686514:0:15076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933406aea800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789427996.686518:0:15076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933406aea800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789427996.686526:0:15076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933406aea800 3 00010000:00080000:0.0:1789427996.686552:0:15076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93341d0d8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.155@tcp at head 00010000:00010000:0.0:1789427996.690674:0:15076:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789427996.690906:0:15076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789427996.690944:0:15076:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789427996.690960:0:15076:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2bea1a57ca34448d 00000100:00080000:0.0:1789427996.690975:0:15076:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789427996.690998:0:15076:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93341d0d8800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789427996.691035:0:15076:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343f997b80 x1876350877136512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789427996.691093:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876350877136512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789427996.691170:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427996.698358:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877136512 00000100:00100000:0.0:1789427996.698374:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877136512 00000100:00100000:0.0:1789427996.698418:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789427996.698425:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1876350877136512:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789427996.698456:0:14369:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1789427996.698519:0:14369:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2bea1a57ca344494 00000004:00100000:0.0:1789427996.698538:0:14369:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789427996.698576:0:14369:0:(import.c:65:import_set_state_nolock()) ffff933406acc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789427996.698645:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1876350877136512:12345-0@lo:38:llog_process_th.0 Request processed in 218us (7475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789427996.698652:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789427996.698693:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93343f997b80 x1876350877136512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789427996.698704:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789427996.698711:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789427996.698726:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789427996.698730:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789427996.698733:0:3297:0:(import.c:65:import_set_state_nolock()) ffff93341d0d8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789427996.698739:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1876350877136512:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789427996.698763:0:15076:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789427996.698816:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789427996.698821:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789427996.698824:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789427996.698827:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789427996.698885:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789427996.698897:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877136640:0@lo:400:kworker.0 00000100:00100000:3.0:1789427996.698946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427996.698983:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877136640 00000100:00100000:3.0:1789427996.698987:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877136640 00000100:00100000:3.0:1789427996.699014:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789427996.699020:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877136640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789427996.699069:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877136640:12345-0@lo:400:kworker.0 Request processed in 49us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427996.699076:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789427996.699101:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93343aca3100 x1876350877136640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789427996.699111:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877136640:0@lo:400:kworker.0 00000040:00080000:1.0:1789427996.702803:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789427996.702864:0:15053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789427996.702891:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789427996.702909:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca344478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34447f expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427996.702923:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400030600/0x2bea1a57ca344478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34447f expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789427996.702982:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789427996.702990:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789427996.702992:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427996.702993:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427996.702994:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427996.702995:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427996.702996:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427996.702998:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427996.702999:0:15053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789427996.703003:0:15053:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789427996.703005:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789427996.703006:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789427996.703007:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427996.703007:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427996.703008:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427996.703009:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427996.703010:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427996.703011:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427996.703012:0:15053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789427996.703049:0:15053:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789427996.703069:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789427996.703144:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427996.703313:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877136768 00000100:00100000:0.0:1789427996.703322:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877136768 00000100:00100000:0.0:1789427996.703369:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789427996.703378:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15053:x1876350877136768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789427996.703404:0:14363:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789427996.703417:0:14363:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789427996.704138:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433db0e40 going to sleep for 11 seconds 20000000:01000000:3.0:1789427996.768414:0:14363:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789427996.768435:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789427996.768496:0:14384:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789427996.768501:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789427996.768521:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427996.768550:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344401 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427996.768557:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427996.768595:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca344401 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789427996.768610:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca344401 expref: 16 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789427996.768624:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1876350877136896:0@lo:104: 00000100:00100000:0.0:1789427996.768705:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789427996.768752:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789427996.768842:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877136896 00000100:00100000:1.0:1789427996.768852:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877136896 00000100:00100000:1.0:1789427996.768901:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789427996.768912:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+3:14384:x1876350877136896:12345-0@lo:104: 00010000:00010000:1.0:1789427996.768926:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427996.768992:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789427996.768998:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+3:14384:x1876350877136896:12345-0@lo:104: Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789427996.769005:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789427996.769072:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789427996.769080:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769088:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d4a00 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789427996.769092:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769101:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789427996.769108:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789427996.769114:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789427996.769156:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769164:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789427996.769220:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769228:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93340e1d4a00/0x2bea1a57ca344401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca344408 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769244:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427996.769245:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789427996.769247:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789427996.769259:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789427996.769268:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877137024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789427996.769303:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789427996.769581:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877137024 00000100:00100000:2.0:1789427996.769586:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877137024 00010000:00010000:2.0:1789427996.769607:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca344401 expref: 17 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427996.769635:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789427996.769642:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92161c2e-b691-4539-8b6b-a6d322602ab0+17:3299:x1876350877137024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789427996.769654:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789427996.769658:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca344401 expref: 17 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769669:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca344401 expref: 17 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769732:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769740:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789427996.769808:0:14355:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001252938s 00010000:00010000:2.0:1789427996.769816:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769823:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769830:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769836:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769853:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789427996.769857:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769864:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769871:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.769881:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789427996.769923:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92161c2e-b691-4539-8b6b-a6d322602ab0+17:3299:x1876350877137024:12345-0@lo:103:ldlm_bl.0 Request processed in 281us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789427996.769931:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789427996.769971:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e178e00/0x2bea1a57ca344408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca344401 expref: 16 pid: 14362 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789427996.769982:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1876350877136896:0@lo:104: 00010000:00010000:2.0:1789427996.769998:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.770007:0:14384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427996.770014:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427996.770015:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877137024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789427996.770021:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e178800/0x2bea1a57ca34449b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427996.782249:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+15:15053:x1876350877136768:12345-0@lo:253:mount.lustre.0 Request processed in 78862us (79095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427996.782275:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789427996.782384:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15053:1876350877136768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789427996.782408:0:15053:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789427996.782412:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789427996.782413:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789427996.782415:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789427996.782416:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789427996.782417:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789427996.782419:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789427996.782420:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789427996.782422:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789427996.782424:0:15053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789427996.782437:0:15053:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789427996.791903:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789427996.792074:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789427996.793572:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789427996.793781:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789427996.793914:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789427996.794136:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789427996.797046:0:15053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789427996.860362:0:15053:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789427996.860371:0:15053:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789427996.860415:0:15053:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789427996.860483:0:15053:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789427996.860498:0:15053:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789427996.860532:0:15053:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789427997.513408:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789427998.473283:0:14365:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789427998.473293:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9333031bc000 from 7 10000000:01000000:1.0:1789427998.473300:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789427998.473370:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427998.473383:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789427998.473394:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789427998.473421:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877137152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789427998.473500:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789427998.473553:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334104c9180 going to sleep for 11 seconds 00000100:00100000:3.0:1789427998.473711:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877137152 00000100:00100000:3.0:1789427998.473720:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877137152 00000100:00100000:3.0:1789427998.473772:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789427998.473779:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+15:14365:x1876350877137152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427998.473794:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789427998.473808:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3444a2 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427998.473831:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3444a2 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427998.473839:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3444a2 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427998.473846:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030e00, rc 0) 00000100:00100000:3.0:1789427998.473885:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+16:14365:x1876350877137152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427998.473890:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789427998.474045:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877137152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789427998.474061:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427998.474071:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789427998.474137:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877137280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789427998.474170:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789427998.474207:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789427998.474218:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877137280 00000100:00100000:3.0:1789427998.474220:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877137280 00000100:00100000:3.0:1789427998.474236:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789427998.474240:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:14365:x1876350877137280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789427998.474252:0:14363:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789427998.474269:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789427998.474272:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789427998.474356:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:14365:x1876350877137280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789427998.474364:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789427998.474401:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877137280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789427998.474465:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789427998.474473:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789427998.474481:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789427998.537871:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789427999.561850:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428000.585800:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428001.609356:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789428001.737327:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428001.737334:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428001.737338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428001.737341:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789428001.737396:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877137536:0@lo:400:kworker.0 00000100:00100000:3.0:1789428001.737415:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877137408:0@lo:400:kworker.0 00000100:00100000:1.0:1789428001.739359:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877137664:0@lo:400:kworker.0 00000100:00100000:3.0:1789428001.742821:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428001.742924:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877137408 00000100:00100000:3.0:1789428001.742933:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877137408 00000100:00100000:3.0:1789428001.742998:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789428001.743009:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+16:3299:x1876350877137408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428001.743091:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+16:3299:x1876350877137408:12345-0@lo:400:kworker.0 Request processed in 85us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428001.743099:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789428001.743171:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877137408:0@lo:400:kworker.0 00000100:00100000:0.0:1789428001.743800:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428001.743846:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877137536 00000100:00100000:0.0:1789428001.743851:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877137536 00000100:00100000:0.0:1789428001.743885:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789428001.743891:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877137536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428001.743932:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877137536:12345-0@lo:400:kworker.0 Request processed in 42us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428001.743938:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789428001.743979:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343f995500 x1876350877137536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428001.743991:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877137536:0@lo:400:kworker.0 00000100:00100000:1.0:1789428001.747002:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428001.747128:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877137664 00000100:00100000:0.0:1789428001.747140:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877137664 00000100:00100000:0.0:1789428001.747217:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789428001.747227:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877137664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428001.747292:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877137664:12345-0@lo:400:kworker.0 Request processed in 66us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428001.747300:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789428001.747329:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343f994380 x1876350877137664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428001.747343:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877137664:0@lo:400:kworker.0 00000100:00080000:1.0:1789428001.747838:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789428002.636617:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789428003.012116:0:15421:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789428003.657385:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428004.683960:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428005.708994:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789428006.541724:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789428006.731113:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428006.857482:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877137792:0@lo:400:kworker.0 00000100:00100000:1.0:1789428006.857597:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428006.857760:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877137792 00000100:00100000:3.0:1789428006.857772:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877137792 00000100:00100000:3.0:1789428006.857841:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789428006.857852:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+16:3298:x1876350877137792:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789428006.857940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428006.857946:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789428006.857948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428006.857952:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789428006.861533:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+16:3298:x1876350877137792:12345-0@lo:400:kworker.0 Request processed in 3667us (3921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428006.861554:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789428006.861849:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877137920:0@lo:400:kworker.0 00000100:00100000:3.0:1789428006.861937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428006.862013:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877137920 00000100:00100000:3.0:1789428006.862024:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877137920 00000100:00100000:3.0:1789428006.862601:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789428006.862613:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877137920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428006.862882:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876350877137920:12345-0@lo:400:kworker.0 Request processed in 271us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428006.862902:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789428006.862955:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343f996a00 x1876350877137920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428006.862972:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876350877137920:0@lo:400:kworker.0 00000100:00100000:1.0:1789428006.863087:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877137792:0@lo:400:kworker.0 00000100:00100000:2.0:1789428006.864301:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877138048:0@lo:400:kworker.0 00000100:00100000:2.0:1789428006.864380:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428006.868985:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877138048 00000100:00100000:0.0:1789428006.869008:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877138048 00000100:00100000:0.0:1789428006.869277:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428006.869290:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877138048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428006.869426:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877138048:12345-0@lo:400:kworker.0 Request processed in 140us (5046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428006.869435:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789428006.869496:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343f995500 x1876350877138048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428006.869515:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877138048:0@lo:400:kworker.0 00000100:00080000:1.0:1789428006.869701:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789428007.755475:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428008.777555:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428008.969313:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789427993/real 1789427993] req@ffff93330387dc00 x1876350877133824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428008 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428008.969358:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93330387dc00 x1876350877133824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428008 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428008.969369:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789427993/real 1789427993] req@ffff93330387c000 x1876350877133952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428008 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428008.969382:0:3297:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93330387c000 x1876350877133952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428008 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789428008.969402:0:3297:0:(import.c:65:import_set_state_nolock()) ffff933433d9e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428008.969420:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789428008.969424:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877133824:0@lo:8:kworker.0 00000100:00080000:1.0:1789428008.969430:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9334089bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428008.969436:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789428008.969439:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877133952:0@lo:8:kworker.0 00000100:00080000:0.0:1789428008.969623:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428008.969628:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789428008.969631:0:38:0:(import.c:65:import_set_state_nolock()) ffff933433d9e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428008.969636:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:0.0:1789428008.969642:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789428008.969651:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff933433d9e000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789428008.969671:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343f996a00 x1876350877138304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428008.969686:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428008.969697:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789428008.969699:0:38:0:(import.c:65:import_set_state_nolock()) ffff9334089bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428008.969703:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:0.0:1789428008.969705:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789428008.969710:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9334089bb000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789428008.969723:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343f994380 x1876350877138432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428008.969773:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877138560:0@lo:400:kworker.0 00000100:00100000:0.0:1789428008.969845:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428008.969850:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789428008.969861:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:92161c2e-b691-4539-8b6b-a6d322602ab0:3300:1876350877138176:0@lo:400:kworker.0 00000100:00100000:0.0:1789428008.969889:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789428008.969893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428008.969894:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877138688:0@lo:400:kworker.0 00000100:00100000:0.0:1789428008.969915:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428008.969930:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877138176 00000100:00100000:2.0:1789428008.969938:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877138176 00000100:00100000:0.0:1789428008.969939:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877138560 00000100:00100000:0.0:1789428008.969942:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877138560 00000100:00100000:0.0:1789428008.969975:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877138688 00000100:00100000:0.0:1789428008.969978:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877138688 00000100:00100000:2.0:1789428008.969979:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789428008.969987:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:3300:x1876350877138176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428008.970004:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428008.970009:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877138560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428008.970031:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:3300:x1876350877138176:12345-0@lo:400:kworker.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428008.970037:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877138560:12345-0@lo:400:kworker.0 Request processed in 29us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428008.970038:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789428008.970043:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428008.970058:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789428008.970063:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877138688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428008.970086:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:92161c2e-b691-4539-8b6b-a6d322602ab0:3300:1876350877138176:0@lo:400:kworker.0 00000100:00100000:0.0:1789428008.970087:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877138688:12345-0@lo:400:kworker.0 Request processed in 25us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428008.970092:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789428008.970118:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789428008.970137:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343f997b80 x1876350877138688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428008.970148:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877138688:0@lo:400:kworker.0 00010000:00080000:0.0:1789428008.970158:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343f995180 x1876350877138560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428008.970165:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877138560:0@lo:400:kworker.0 00000100:00100000:0.0:1789428008.970211:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877138304:0@lo:8:kworker.0 00000100:00100000:0.0:1789428008.970239:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428008.970271:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877138432:0@lo:8:kworker.0 00000100:00100000:0.0:1789428008.970290:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428008.970528:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877138304 00000100:00100000:2.0:1789428008.970530:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877138432 00000100:00100000:2.0:1789428008.970533:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877138432 00000100:00100000:1.0:1789428008.970533:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877138304 00000100:00100000:2.0:1789428008.970559:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428008.970563:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876350877138432:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789428008.970581:0:15055:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789428008.970615:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876350877138432:12345-0@lo:8:kworker.0 Request processed in 51us (324us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789428008.970621:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428008.970632:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428008.970635:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876350877138304:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789428008.970650:0:15055:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1789428008.970679:0:15055:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca3444b0 00002000:00100000:2.0:1789428008.970693:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93341004a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789428008.970698:0:15055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789428008.970701:0:15055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1789428008.970843:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9334089bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428008.970848:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789428008.970851:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877138432:0@lo:8:kworker.0 00002000:00080000:2.0:1789428008.971038:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789428008.971060:0:15055:0:(import.c:65:import_set_state_nolock()) ffff93341004d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428008.971109:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1876350877138304:12345-0@lo:8:kworker.0 Request processed in 471us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428008.971115:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789428008.971141:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343f996a00 x1876350877138304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789428028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428008.971150:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789428008.971156:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789428008.971162:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789428008.971167:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789428008.971169:0:3297:0:(import.c:65:import_set_state_nolock()) ffff933433d9e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789428008.971212:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789428008.971217:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877138304:0@lo:8:kworker.0 00000004:00080000:2.0:1789428008.971232:0:14390:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789428008.971373:0:14391:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1789428008.971391:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1876350877138944:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789428008.971429:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428008.971448:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789428008.971460:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789428008.971467:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877138816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428008.971490:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428008.971514:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877138944 00000100:00100000:1.0:1789428008.971518:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877138944 00000004:00080000:2.0:1789428008.971549:0:14390:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 463906373433ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789428008.971551:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428008.971559:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14391:x1876350877138944:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789428008.971576:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877138816 00000100:00100000:2.0:1789428008.971579:0:15058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877138816 00000100:00100000:2.0:1789428008.971598:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428008.971610:0:15058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876350877138816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428008.971629:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789428008.971662:0:15058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876350877138816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428008.971667:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789428008.975325:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1789428008.975685:0:15056:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789428008.975695:0:15056:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789428008.975701:0:15056:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00080000:0.0:1789428008.977929:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93341e215f80 x1876350877138816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789428024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428008.977967:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877138816:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1789428008.994104:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428008.994122:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428008.994146:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428008.994152:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428008.994169:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428008.994222:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428008.994235:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428008.994259:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428008.994290:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428008.994352:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428008.994366:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428008.994384:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428008.994390:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428008.994402:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428008.994432:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428008.994440:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000336cea67/0x2bea1a57ca3444b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428008.994474:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428008.994476:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428008.994479:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.000391:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.000412:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.000961:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.000967:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.000975:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.000995:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.001009:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.001018:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.001051:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428009.001153:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428009.001202:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.001220:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700000 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428009.001225:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.001236:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.001257:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.001265:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df65a976/0x2bea1a57ca3444be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.001340:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.001343:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.001345:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.008155:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.008197:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.008235:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.008241:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.008249:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.008268:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.008280:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.008290:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.008325:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789428009.008937:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.008944:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.008955:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.008959:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.008964:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.008975:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.008997:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009005:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009029:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789428009.009048:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428009.009055:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009064:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428009.009070:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009081:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009101:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009110:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009136:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428009.009146:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009154:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701200 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428009.009157:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009165:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009220:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009229:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009244:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.009245:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.009248:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.009741:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.009749:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009760:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.009763:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.009768:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009791:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009802:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.009810:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.012574:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428009.012965:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428009.012980:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.013025:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.013069:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700c00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428009.013075:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.013087:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.013117:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.013125:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3cf968c/0x2bea1a57ca3444d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.013158:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.013160:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.013162:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.015395:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.015414:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.015608:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.015614:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.015631:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.015834:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.015849:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.015873:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.015902:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428009.015933:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428009.015949:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.015963:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428009.015968:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.015991:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.016019:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.016026:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009425eedf/0x2bea1a57ca3444da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.016058:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.016075:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.016078:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.017353:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.017366:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.017383:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.017388:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.017395:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.017409:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.017613:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.017795:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.017839:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428009.017883:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428009.017897:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.017909:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701200 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428009.017915:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.017925:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.017947:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.017954:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca3444e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.017988:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.017991:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.017993:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.018986:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.018997:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.019018:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.019023:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.019028:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.019041:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.019051:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.019058:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.019082:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428009.019210:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428009.019219:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.019230:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428009.019235:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.019259:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.019274:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.019281:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2402cad/0x2bea1a57ca3444e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.019302:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.019304:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.019305:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.023495:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.023515:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.023541:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.023546:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.023554:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.023577:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.023608:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.023618:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.023659:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428009.025385:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428009.025401:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.025435:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428009.025441:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.025456:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.025483:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.025492:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007596ca02/0x2bea1a57ca3444ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.025525:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.025528:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.025534:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.026464:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.026480:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.026499:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.026505:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.026513:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.026532:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.026544:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.026552:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.030085:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428009.030115:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428009.030129:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.030144:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428009.030150:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.030162:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789428009.030451:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789428009.030548:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.030580:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f3cb11a/0x2bea1a57ca3444f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.030619:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.030621:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.030623:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.034686:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.034707:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.034733:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.034739:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.034747:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.034766:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.034780:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.034788:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.034814:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428009.035312:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428009.035332:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.035349:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701c00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428009.035354:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.035381:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.035407:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.035416:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cb1d573/0x2bea1a57ca3444fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.035458:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.035462:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.035463:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.035536:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.035545:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.035557:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.035568:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.035573:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.035587:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.035596:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.035603:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.035630:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428009.035855:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428009.035864:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.035876:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428009.035881:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.035889:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.035908:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.035915:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042fd3d6b/0x2bea1a57ca344504 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.035934:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.035935:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.035937:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.036139:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.036147:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036158:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.036161:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.036165:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036203:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036214:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036229:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036246:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428009.036321:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428009.036330:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.036339:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700200 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428009.036343:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.036353:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.036368:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.036391:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aab4468d/0x2bea1a57ca34450b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.036416:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.036418:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.036422:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428009.036702:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428009.036709:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036718:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789428009.036722:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428009.036725:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036734:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036742:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036749:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.036770:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428009.036809:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428009.036826:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.036835:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428009.036838:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.036846:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.036859:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.036866:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef255f3/0x2bea1a57ca344512 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.036884:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.036885:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.036887:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428009.047145:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.047159:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.047200:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1789428009.047205:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.047212:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.047227:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.047238:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.047247:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.047272:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789428009.047318:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428009.047335:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.047368:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178200 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428009.047374:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.047387:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.047414:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.047423:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d3b611d/0x2bea1a57ca344519 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.047455:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.047457:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.047458:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428009.050652:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.050671:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.050687:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1789428009.050691:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.050697:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.050712:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.050721:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.050729:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.050756:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789428009.051743:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428009.051756:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.051767:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428009.051772:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.051782:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.051808:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.051826:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d35481/0x2bea1a57ca344520 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.051848:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.051849:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.051852:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428009.053945:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.053961:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.055025:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1789428009.055036:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.055046:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.055066:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.055087:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.055095:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.055166:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428009.058146:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.058159:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.058195:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1789428009.058200:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.058207:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.058223:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.058233:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.058242:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.058637:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428009.058647:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.058655:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428009.058660:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.058669:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.058686:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.058694:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000474d17de/0x2bea1a57ca344527 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.059026:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428009.059031:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.059039:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428009.059042:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.059050:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.059062:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.059070:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.059071:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.059074:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.060620:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428009.060637:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34452e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.060761:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428009.063253:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.063267:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.063287:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1789428009.063291:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.063297:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.063311:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.063321:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.063328:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.063355:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428009.064313:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.064324:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.064342:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1789428009.064346:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.064351:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.064362:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.064371:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.064378:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.064398:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789428009.066265:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.066277:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.066293:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1789428009.066298:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.066304:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066597:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428009.066605:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066613:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428009.066618:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066640:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066660:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066666:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b33a504/0x2bea1a57ca344535 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066683:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428009.066687:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066693:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428009.066695:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066702:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066710:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066717:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34453c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428009.066740:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.066742:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.066744:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428009.066750:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.068192:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.068233:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.068242:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.068467:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428009.073161:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428009.073825:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.073842:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179c00 already unused, calling callback (ffffffffc17d28b0) 00002000:00010000:0.0:1789428009.073843:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789428009.073849:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073851:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073865:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789428009.073869:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073869:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.073876:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073886:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.073887:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.073895:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d156d7db/0x2bea1a57ca344543 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073896:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073904:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428009.073913:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.073914:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.073916:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.073933:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428009.073944:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428009.073948:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073955:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428009.073958:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073967:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073976:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073983:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a315b4b5/0x2bea1a57ca34454a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.073995:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.073997:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.073998:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428009.074708:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.074715:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.074726:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1789428009.074735:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.074740:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.074749:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.074757:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.074764:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.074783:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428009.075152:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.075156:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.075162:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1789428009.075164:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.075167:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.075198:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.075207:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.075220:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.075240:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789428009.076219:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428009.076231:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076245:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428009.076251:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076263:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076295:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076303:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad4eed65/0x2bea1a57ca344551 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076321:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428009.076325:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076331:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428009.076335:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076342:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076351:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076357:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba351fa2/0x2bea1a57ca344558 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.076367:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428009.076368:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428009.076374:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.076715:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428009.076944:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.076952:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.076964:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1789428009.076969:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.076974:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.076984:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.076993:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.077001:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.077149:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428009.077660:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.077667:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.077683:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1789428009.077687:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.077691:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.077700:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.077708:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.077715:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078168:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428009.078189:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078199:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178c00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428009.078203:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078213:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078228:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078235:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f994faf/0x2bea1a57ca34455f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078252:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428009.078256:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078262:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428009.078265:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078273:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078290:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.078297:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428009.078299:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428009.078301:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428009.078581:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428009.078588:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce2435e6/0x2bea1a57ca344566 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428009.079074:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428009.079081:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.079091:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1789428009.079095:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428009.079100:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.079124:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.079133:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.079140:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428009.079163:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789428009.079498:0:15056:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1789428009.079604:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14391:x1876350877138944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 108042us (108170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428009.079619:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789428009.079775:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428009.079781:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.079791:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428009.079795:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.079804:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.079829:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.079837:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca34456d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428009.079855:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428009.079857:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428009.079858:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428009.079935:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428009.080651:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1876350877138944:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789428009.080664:0:14391:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1789428009.080705:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1876350877139072:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789428009.080738:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428009.080781:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877139072 00000100:00100000:1.0:1789428009.080785:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d5b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789428009.080789:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877139072 00000100:00100000:0.0:1789428009.080879:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789428009.080888:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14391:x1876350877139072:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789428009.080929:0:15055:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1789428009.090510:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14391:x1876350877139072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9614us (9761us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789428009.090525:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428009.091140:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1876350877139072:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789428009.091158:0:14391:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789428009.803960:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789428010.102934:0:15772:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789428010.102940:0:15772:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789428010.103102:0:15772:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93341c3ff000 00000020:01000004:3.0:1789428010.103121:0:15772:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789428010.103136:0:15772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789428010.103161:0:15772:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9333031d4d40) 00000020:00000080:3.0:1789428010.103213:0:15772:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789428010.119965:0:15772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789428010.120478:0:15772:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789428010.121637:0:15772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789428010.121893:0:15772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789428010.122136:0:15772:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789428010.122646:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 171: rc = 0 00100000:10000000:2.0:1789428010.122812:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 171: rc = 0 00100000:10000000:2.0:1789428010.122940:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 171: rc = 0 00100000:10000000:2.0:1789428010.123524:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 213: rc = 0 00100000:10000000:2.0:1789428010.123770:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 213: rc = 0 00100000:10000000:2.0:1789428010.124127:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 213: rc = 0 00100000:10000000:2.0:1789428010.124548:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 213: rc = 0 00100000:10000000:2.0:1789428010.124808:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 213: rc = 0 00100000:10000000:2.0:1789428010.125067:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 213: rc = 0 00000020:00000080:2.0:1789428010.125914:0:15772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789428010.125926:0:15772:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789428010.125936:0:15772:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bea1a57ca34457b 00000020:01000004:2.0:1789428010.125944:0:15772:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789428010.125966:0:15772:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789428010.125970:0:15772:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789428010.125975:0:15772:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789428010.125998:0:15772:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789428010.126002:0:15772:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789428010.134502:0:15772:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789428010.134546:0:15772:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.155@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789428010.134552:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789428010.134554:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789428010.134556:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428010.134557:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428010.134559:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428010.134560:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428010.134562:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428010.134564:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428010.134565:0:15772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789428010.134570:0:15772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789428010.134572:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789428010.134574:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789428010.134575:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428010.134576:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428010.134577:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428010.134578:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428010.134579:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428010.134580:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428010.134581:0:15772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789428010.134608:0:15772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789428010.134633:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139200:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789428010.134710:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428010.134760:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789428010.135011:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877139200 00000100:00100000:1.0:1789428010.135021:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877139200 00000100:00100000:1.0:1789428010.135094:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789428010.135106:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15772:x1876350877139200:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789428010.135148:0:14361:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789428010.135153:0:14361:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789428010.135159:0:14361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789428010.152225:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15772:x1876350877139200:12345-0@lo:253:mount.lustre.0 Request processed in 17111us (17503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428010.152240:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789428010.152504:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139200:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789428010.152521:0:15772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789428010.152544:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789428010.152546:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789428010.152547:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428010.152549:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428010.152550:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428010.152552:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428010.152553:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428010.152555:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428010.152557:0:15772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789428010.152581:0:15772:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93341c3ff000 from lustre-OST0001 10000000:01000000:3.0:1789428010.152619:0:15772:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789428010.152622:0:15772:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789428010.152631:0:15772:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93341deb4d40 local copy 00010000:00010000:3.0:1789428010.152642:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428010.152980:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428010.153021:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428010.153068:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340de5a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789428010.153135:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877139328 00000100:00100000:2.0:1789428010.153142:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877139328 00000100:00100000:3.0:1789428010.153266:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789428010.153277:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15772:x1876350877139328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428010.153475:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15772:x1876350877139328:12345-0@lo:501:mount.lustre.0 Request processed in 200us (452us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789428010.153483:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789428010.153622:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139328:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789428010.153636:0:15772:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789428010.153762:0:15772:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789428010.153773:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428010.153781:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933420701000/0x2bea1a57ca344328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34432f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428010.153814:0:15772:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93341c3ff000 10000000:01000000:0.0:1789428010.153819:0:15772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789428010.153827:0:15772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789428010.153830:0:15772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789428010.153834:0:15772:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789428010.153837:0:15772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789428010.153864:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178400/0x2bea1a57ca344582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428010.153872:0:15772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93341e178400/0x2bea1a57ca344582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428010.153882:0:15772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93341e178400/0x2bea1a57ca344582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428010.153897:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428010.153932:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.153967:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428010.154034:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877139456 00000100:00100000:1.0:1789428010.154040:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877139456 00000100:00100000:1.0:1789428010.154074:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789428010.154081:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+16:15772:x1876350877139456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428010.154097:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428010.154112:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933420700e00/0x2bea1a57ca344589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344582 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.154135:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933420700e00/0x2bea1a57ca344589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344582 expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.154148:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933420700e00/0x2bea1a57ca344589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344582 expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.154159:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700e00, rc 0) 00000100:00100000:1.0:1789428010.154224:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877139456:12345-0@lo:101:mount.lustre.0 Request processed in 143us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428010.154231:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789428010.154322:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139456:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428010.154335:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93341e178400/0x2bea1a57ca344582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344589 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428010.154344:0:15772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93341e178400/0x2bea1a57ca344582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca344589 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428010.154961:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789428010.155843:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428010.156143:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789428010.156217:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789428010.156257:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789428010.156318:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789428010.156350:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789428010.156380:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789428010.156446:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789428010.156454:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789428010.156550:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428010.156622:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.156675:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428010.156880:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877139584 00000100:00100000:3.0:1789428010.156888:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877139584 00000100:00100000:3.0:1789428010.156924:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789428010.156934:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877139584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428010.157482:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877139584:12345-0@lo:501:mount.lustre.0 Request processed in 548us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428010.157498:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789428010.159518:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428010.159589:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428010.159662:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.159708:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428010.159804:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877139712 00000100:00100000:3.0:1789428010.159812:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877139712 00000100:00100000:3.0:1789428010.159869:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789428010.159878:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877139712:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428010.160273:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877139712:12345-0@lo:503:mount.lustre.0 Request processed in 395us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428010.160282:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789428010.160540:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139712:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789428010.161238:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789428010.161435:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428010.161494:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.161528:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428010.161637:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877139840 00000100:00100000:2.0:1789428010.161645:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877139840 00000100:00100000:2.0:1789428010.161680:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789428010.161688:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877139840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428010.161905:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877139840:12345-0@lo:502:mount.lustre.0 Request processed in 217us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428010.161913:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789428010.162218:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428010.162509:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789428010.162563:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789428010.162610:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789428010.162660:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789428010.162699:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789428010.162731:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789428010.162779:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789428010.162831:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789428010.162880:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789428010.162911:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428010.162959:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.162994:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420e9ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428010.163205:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877139968 00000100:00100000:2.0:1789428010.163212:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877139968 00000100:00100000:2.0:1789428010.163240:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789428010.163247:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877139968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428010.163426:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877139968:12345-0@lo:502:mount.lustre.0 Request processed in 179us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428010.163434:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789428010.163587:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877139968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428010.163659:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789428010.163669:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789428010.164732:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789428010.164743:0:15773:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789428010.164751:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428010.164753:0:15773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789428010.164760:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789428010.164774:0:15773:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff933406148000) 00000020:00000080:1.0:1789428010.164804:0:15773:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789428010.164810:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789428010.164897:0:15773:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93341c3ff000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789428010.164907:0:15773:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789428010.164913:0:15773:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bea1a57ca344597 00010000:00010000:1.0:1789428010.169016:0:15773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789428010.169719:0:15773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789428010.171727:0:15773:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789428010.173520:0:15773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789428010.173534:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428010.173547:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428010.173549:0:15773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789428010.173555:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428010.173559:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428010.173560:0:15773:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789428010.173563:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789428010.173565:0:15773:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789428010.173568:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428010.173570:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428010.173571:0:15773:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789428010.173574:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428010.173576:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428010.173577:0:15773:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789428010.173580:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789428010.173640:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428010.173643:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428010.173644:0:15773:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789428010.173648:0:15773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789428010.173820:0:15772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789428010.173851:0:15772:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789428010.173876:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93341e178400/0x2bea1a57ca344582 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344589 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.173889:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93341e178400/0x2bea1a57ca344582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344589 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428010.173897:0:15772:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93341c3ff000 from 1 10000000:01000000:2.0:1789428010.173900:0:15772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789428010.173939:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.173948:0:15772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.173959:0:15772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428010.173987:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428010.174064:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428010.174114:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428010.174270:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877140096 00000100:00100000:1.0:1789428010.174279:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877140096 00000100:00100000:1.0:1789428010.174447:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789428010.174458:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+17:15772:x1876350877140096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428010.174474:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428010.174487:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca34459e expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.174516:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca34459e expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.174528:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34459e expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.174536:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700200, rc 0) 00000100:00100000:1.0:1789428010.174591:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140096:12345-0@lo:101:mount.lustre.0 Request processed in 135us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428010.174598:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789428010.175912:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428010.175933:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.175946:0:15772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789428010.176527:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789428010.177146:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428010.177449:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789428010.177497:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789428010.177577:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789428010.177586:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789428010.177663:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428010.177729:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428010.180142:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d05480 going to sleep for 11 seconds 00000100:00100000:3.0:1789428010.184479:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877140224 00000100:00100000:3.0:1789428010.184497:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877140224 00000100:00100000:3.0:1789428010.184558:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789428010.184569:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428010.184892:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140224:12345-0@lo:501:mount.lustre.0 Request processed in 324us (7160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428010.184900:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789428010.185107:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428010.185153:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140352:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428010.185217:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428010.185246:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789428010.185319:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877140352 00000100:00100000:1.0:1789428010.185324:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877140352 00000100:00100000:1.0:1789428010.185350:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789428010.185358:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140352:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428010.185576:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140352:12345-0@lo:503:mount.lustre.0 Request processed in 218us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428010.185583:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789428010.185728:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140352:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789428010.186305:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428010.186373:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428010.186410:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428010.186437:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420f5ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789428010.186596:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877140480 00000100:00100000:1.0:1789428010.186602:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877140480 00000100:00100000:1.0:1789428010.186626:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789428010.186633:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428010.186809:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140480:12345-0@lo:502:mount.lustre.0 Request processed in 162us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428010.186817:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789428010.186858:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789428010.187087:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789428010.187131:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789428010.187168:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789428010.187224:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789428010.187251:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789428010.187288:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789428010.187870:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789428010.187904:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789428010.187943:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428010.188007:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428010.188050:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877140608 00000100:00100000:1.0:1789428010.188056:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877140608 00000100:00100000:1.0:1789428010.188088:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789428010.188096:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140608:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428010.188281:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140608:12345-0@lo:502:mount.lustre.0 Request processed in 185us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428010.188289:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789428010.188905:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334053b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789428010.188931:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789428010.189054:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789428010.189066:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789428010.190159:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428010.190171:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428010.193419:0:15777:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789428010.193466:0:15777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93341c3ff000 00000020:00000080:3.0:1789428010.193471:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428010.193486:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428010.193490:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428010.193491:0:15777:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789428010.193494:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428010.193497:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428010.193498:0:15777:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789428010.193502:0:15777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93341c3ff000 00000020:00000080:3.0:1789428010.193504:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428010.193718:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428010.193723:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428010.193724:0:15777:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789428010.193727:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428010.193730:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428010.193731:0:15777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789428010.193734:0:15777:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93341c3ff000 00000020:00000080:3.0:1789428010.193736:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428010.195401:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428010.195413:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428010.195415:0:15777:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789428010.195420:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789428010.201890:0:15772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789428010.201948:0:15772:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789428010.201976:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.201989:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428010.202045:0:15772:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789428010.202048:0:15772:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93341c3ff000 10000000:01000000:1.0:1789428010.202051:0:15772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93341c3ff000 10000000:01000000:1.0:1789428010.202055:0:15772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789428010.202063:0:15772:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93341c3ff000 from 1 10000000:01000000:1.0:1789428010.202065:0:15772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789428010.202104:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420701c00/0x2bea1a57ca3445ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.202124:0:15772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933420701c00/0x2bea1a57ca3445ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.202135:0:15772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933420701c00/0x2bea1a57ca3445ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428010.202162:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789428010.202263:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428010.202320:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421485480 going to sleep for 11 seconds 00000100:00100000:3.0:1789428010.203582:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877140736 00000100:00100000:3.0:1789428010.203601:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877140736 00000100:00100000:3.0:1789428010.203660:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789428010.203670:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877140736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428010.203689:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428010.203711:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400030800/0x2bea1a57ca3445b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3445ac expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428010.203760:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030800/0x2bea1a57ca3445b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3445ac expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428010.203774:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400030800/0x2bea1a57ca3445b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3445ac expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428010.203784:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030800, rc 0) 00000100:00100000:3.0:1789428010.209480:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877140736:12345-0@lo:101:mount.lustre.0 Request processed in 5799us (7204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428010.209497:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789428010.209664:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428010.209697:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933420701c00/0x2bea1a57ca3445ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3445b3 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428010.209712:0:15772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933420701c00/0x2bea1a57ca3445ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3445b3 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789428010.210588:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789428010.210951:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789428010.211290:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789428010.211414:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789428010.211450:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789428010.211517:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789428010.211557:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789428010.211619:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789428010.211658:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789428010.211692:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789428010.211749:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789428010.211786:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789428010.211842:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789428010.211889:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789428010.211924:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789428010.211957:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789428010.212005:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789428010.212043:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789428010.212078:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789428010.212124:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789428010.212250:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789428010.212380:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789428010.212438:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789428010.212474:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789428010.212509:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789428010.212558:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789428010.212594:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789428010.212629:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789428010.212679:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789428010.212717:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789428010.212755:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789428010.212828:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789428010.212866:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789428010.212901:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789428010.212938:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789428010.212988:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789428010.213024:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789428010.213088:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789428010.213122:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789428010.213285:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789428010.213368:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789428010.213481:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428010.213549:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428010.213606:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877140864 00000100:00100000:1.0:1789428010.213620:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877140864 00000100:00100000:1.0:1789428010.213708:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789428010.213717:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877140864:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428010.213966:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877140864:12345-0@lo:501:mount.lustre.0 Request processed in 249us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428010.213974:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789428010.214081:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421485480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428010.214103:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428010.214136:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428010.214274:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428010.214387:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933406a7f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789428010.214420:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877140992 00000100:00100000:3.0:1789428010.214425:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877140992 00000100:00100000:3.0:1789428010.214456:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789428010.214463:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877140992:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428010.214782:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877140992:12345-0@lo:503:mount.lustre.0 Request processed in 318us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428010.214789:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789428010.214861:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877140992:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789428010.215518:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789428010.215593:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877141120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428010.215643:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428010.215725:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421485480 going to sleep for 11 seconds 00000100:00100000:3.0:1789428010.215763:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877141120 00000100:00100000:3.0:1789428010.215769:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877141120 00000100:00100000:3.0:1789428010.215812:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789428010.215820:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877141120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428010.216106:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877141120:12345-0@lo:502:mount.lustre.0 Request processed in 284us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428010.216114:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789428010.217410:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877141120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789428010.217734:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789428010.217805:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789428010.217843:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789428010.217889:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789428010.217921:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789428010.217960:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789428010.217992:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789428010.218019:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789428010.218060:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789428010.218090:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789428010.218135:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789428010.218204:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789428010.218239:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789428010.218266:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789428010.219452:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789428010.219539:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789428010.219577:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789428010.219626:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789428010.219662:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789428010.219696:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789428010.219753:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789428010.219791:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789428010.219841:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789428010.219885:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789428010.219918:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789428010.219947:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789428010.220010:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789428010.220045:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789428010.220079:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789428010.220129:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789428010.220165:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789428010.220225:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789428010.220260:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789428010.221436:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789428010.221508:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789428010.221560:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789428010.221598:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789428010.221634:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789428010.221683:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789428010.221720:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789428010.221773:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877141248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428010.221868:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.221927:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877141248 00000100:00100000:1.0:1789428010.221932:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff933406a7f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789428010.221935:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877141248 00000100:00100000:0.0:1789428010.225735:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789428010.225756:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877141248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428010.228378:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877141248:12345-0@lo:502:mount.lustre.0 Request processed in 2622us (6502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428010.228393:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789428010.229094:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877141248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789428010.229486:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789428010.229504:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789428010.233001:0:15782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789428010.233020:0:15782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9333031d19c0) 00000020:00000080:3.0:1789428010.233052:0:15782:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789428010.233134:0:15782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93341c3ff000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789428010.233139:0:15782:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93341c3ff000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789428010.233141:0:15782:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93341c3ff000 3 00010000:00080000:3.0:1789428010.233564:0:15782:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9334201c1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.155@tcp at head 00010000:00010000:3.0:1789428010.237894:0:15782:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789428010.238155:0:15782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789428010.238226:0:15782:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789428010.238241:0:15782:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2bea1a57ca3445c1 00000100:00080000:3.0:1789428010.238251:0:15782:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789428010.238263:0:15782:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9334201c1800 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:3.0:1789428010.238440:0:15782:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343aca0380 x1876350877141376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789428010.238472:0:15782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789428010.239882:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876350877141376:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789428010.239965:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.240038:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877141376 00000100:00100000:0.0:1789428010.240046:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877141376 00000100:00100000:0.0:1789428010.240084:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789428010.240091:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1876350877141376:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789428010.240120:0:14368:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:0.0:1789428010.240202:0:14368:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2bea1a57ca3445c8 00000004:00100000:0.0:1789428010.240220:0:14368:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789428010.240255:0:14368:0:(import.c:65:import_set_state_nolock()) ffff9334335f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428010.240906:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1876350877141376:12345-0@lo:38:llog_process_th.0 Request processed in 812us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428010.240915:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789428010.240968:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343aca0380 x1876350877141376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428010.240979:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789428010.240987:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789428010.240996:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789428010.241000:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789428010.241003:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9334201c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789428010.241009:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1876350877141376:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789428010.241329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789428010.241335:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789428010.241337:0:36:0:(import.c:65:import_set_state_nolock()) ffff9334089bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428010.241343:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:0.0:1789428010.241347:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789428010.241355:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9334089bb000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:0.0:1789428010.241374:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93343f994700 x1876350877141632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428010.241439:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877141504:0@lo:400:kworker.0 00000100:00100000:0.0:1789428010.241474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.241519:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877141760:0@lo:400:kworker.0 00000100:00100000:0.0:1789428010.241544:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.241564:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789428010.241570:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877141888:0@lo:400:kworker.0 00000100:00100000:0.0:1789428010.241591:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.241631:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877141504 00000100:00100000:0.0:1789428010.241637:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877141504 00000100:00100000:0.0:1789428010.241687:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789428010.241696:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1876350877141504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428010.241737:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1876350877141504:12345-0@lo:400:kworker.0 Request processed in 42us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428010.241743:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789428010.241763:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877141760 00000100:00100000:0.0:1789428010.241766:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877141760 00000100:00100000:0.0:1789428010.241787:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877141888 00000100:00100000:0.0:1789428010.241790:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877141888 00000100:00100000:0.0:1789428010.241819:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789428010.241825:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877141760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428010.241860:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877141760:12345-0@lo:400:kworker.0 Request processed in 34us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428010.241866:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789428010.241879:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789428010.241885:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877141888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428010.241913:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876350877141888:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428010.241919:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789428010.241939:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789428010.241950:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428010.241976:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877141504:0@lo:400:kworker.0 00010000:00080000:0.0:1789428010.242002:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343f995c00 x1876350877141888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428010.242012:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876350877141888:0@lo:400:kworker.0 00010000:00080000:0.0:1789428010.242021:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93343f996d80 x1876350877141760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428010.242029:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877141760:0@lo:400:kworker.0 00000100:00100000:0.0:1789428010.242052:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877141632:0@lo:8:kworker.0 00000100:00100000:0.0:1789428010.242076:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.242110:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877141632 00000100:00100000:0.0:1789428010.242115:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877141632 00000100:00100000:0.0:1789428010.242134:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789428010.242139:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876350877141632:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789428010.242226:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1876350877141632:12345-0@lo:8:kworker.0 Request processed in 85us (147us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789428010.242232:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789428010.242270:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789428010.242275:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9334089bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428010.242279:0:3297:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789428010.242282:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877141632:0@lo:8:kworker.0 00000040:00080000:3.0:1789428010.249684:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789428010.249908:0:15772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789428010.249944:0:15772:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789428010.249970:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933420701c00/0x2bea1a57ca3445ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3445b3 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428010.250001:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933420701c00/0x2bea1a57ca3445ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3445b3 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789428010.250051:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789428010.250054:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789428010.250056:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428010.250057:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428010.250059:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428010.250060:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428010.250062:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789428010.250065:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428010.250066:0:15772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789428010.250071:0:15772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789428010.250073:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789428010.250075:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789428010.250076:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428010.250077:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428010.250078:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428010.250080:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428010.250081:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789428010.250082:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428010.250083:0:15772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789428010.250113:0:15772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789428010.250138:0:15772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877142016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789428010.250254:0:15772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428010.250453:0:15772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334038ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1789428010.250482:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877142016 00000100:00100000:0.0:1789428010.250491:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877142016 00000100:00100000:0.0:1789428010.250543:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789428010.250553:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:15772:x1876350877142016:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789428010.250585:0:14361:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789428010.250598:0:14361:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789428010.289399:0:14361:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789428010.289415:0:14361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789428010.289449:0:14384:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789428010.289453:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789428010.289477:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.289497:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3444a2 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.289505:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.289545:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca3444a2 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.289560:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca3444a2 expref: 19 pid: 14362 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428010.289574:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1876350877142144:0@lo:104: 00000100:00100000:2.0:1789428010.289639:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428010.289680:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433d056c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428010.289710:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877142144 00000100:00100000:2.0:1789428010.289732:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877142144 00000100:00100000:2.0:1789428010.289780:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789428010.289790:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:92161c2e-b691-4539-8b6b-a6d322602ab0+3:14384:x1876350877142144:12345-0@lo:104: 00010000:00010000:2.0:1789428010.289811:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.289861:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789428010.289868:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:92161c2e-b691-4539-8b6b-a6d322602ab0+3:14384:x1876350877142144:12345-0@lo:104: Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428010.289875:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789428010.289901:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428010.289908:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.289915:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700400 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789428010.289920:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.289929:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428010.289937:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428010.289943:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789428010.289970:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.289976:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428010.289998:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290023:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933420700400/0x2bea1a57ca3444a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3444a9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290040:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428010.290042:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428010.290044:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428010.290063:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:92161c2e-b691-4539-8b6b-a6d322602ab0:3300:1876350877142272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428010.290094:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428010.290136:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877142272 00000100:00100000:2.0:1789428010.290141:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877142272 00010000:00010000:2.0:1789428010.290156:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3444a2 expref: 20 pid: 14362 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428010.290202:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789428010.290209:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+20:3300:x1876350877142272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428010.290220:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428010.290225:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca3444a2 expref: 20 pid: 14362 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290236:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca3444a2 expref: 20 pid: 14362 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290251:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290259:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789428010.290270:0:14353:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001252938s 00010000:00010000:2.0:1789428010.290280:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290288:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290295:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290301:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290307:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d5800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428010.290311:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290319:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290328:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290337:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428010.290368:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+20:3300:x1876350877142272:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428010.290375:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789428010.290412:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:92161c2e-b691-4539-8b6b-a6d322602ab0:3300:1876350877142272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428010.290438:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400030e00/0x2bea1a57ca3444a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca3444a2 expref: 19 pid: 14362 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428010.290448:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1876350877142144:0@lo:104: 00010000:00010000:2.0:1789428010.290465:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290474:0:14384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290479:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428010.290486:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93340e1d5800/0x2bea1a57ca3445cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428010.319400:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:15772:x1876350877142016:12345-0@lo:253:mount.lustre.0 Request processed in 68836us (69134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428010.319417:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789428010.319750:0:15772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:92161c2e-b691-4539-8b6b-a6d322602ab0:15772:1876350877142016:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789428010.319770:0:15772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789428010.319774:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789428010.319776:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789428010.319777:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428010.319778:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428010.319780:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428010.319781:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428010.319782:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789428010.319784:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428010.319786:0:15772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789428010.319814:0:15772:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789428010.324065:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789428010.325787:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789428010.326075:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789428010.326263:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789428010.327733:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789428010.327977:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789428010.329474:0:15772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789428010.432997:0:15772:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789428010.433008:0:15772:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789428010.433044:0:15772:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789428010.433113:0:15772:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789428010.433126:0:15772:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789428010.433155:0:15772:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789428010.825496:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789428011.407131:0:14365:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789428011.407139:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9333031bc000 from 8 10000000:01000000:3.0:1789428011.407145:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789428011.407211:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3445d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428011.407223:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3445d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428011.407235:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3445d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428011.407259:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877142400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789428011.407337:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428011.407391:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff93343a8c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428011.407734:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877142400 00000100:00100000:0.0:1789428011.407742:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877142400 00000100:00100000:0.0:1789428011.407806:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789428011.407815:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+18:14365:x1876350877142400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428011.407830:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428011.407847:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93341e178200/0x2bea1a57ca3445dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca3445d6 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428011.407870:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93341e178200/0x2bea1a57ca3445dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca3445d6 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428011.407881:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93341e178200/0x2bea1a57ca3445dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca3445d6 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428011.407897:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93341e178200, rc 0) 00000100:00100000:0.0:1789428011.407936:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:14365:x1876350877142400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428011.407943:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789428011.409122:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877142400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428011.409146:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3445d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3445dd expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428011.409158:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3445d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca3445dd expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428011.409265:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877142528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789428011.409482:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428011.409525:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff93343a8c53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428011.409591:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877142528 00000100:00100000:2.0:1789428011.409597:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877142528 00000100:00100000:2.0:1789428011.409641:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789428011.409650:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:14365:x1876350877142528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789428011.409667:0:14361:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789428011.409685:0:14361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789428011.409688:0:14361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789428011.409802:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:14365:x1876350877142528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428011.409813:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789428011.416682:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343aca0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877142528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789428011.416799:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789428011.416811:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3445d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3445dd expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428011.416823:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933400031e00/0x2bea1a57ca3445d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca3445dd expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428011.852714:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789428012.646042:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789428012.646098:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789428012.873796:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428013.898326:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428014.027090:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789428014.027125:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877142656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428014.027547:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428014.028128:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877142656 00000100:00100000:0.0:1789428014.028142:0:15058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877142656 00000100:00080000:2.0:1789428014.028712:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789428014.033054:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789428014.033078:0:15058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877142656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789428014.033138:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789428014.033570:0:15058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877142656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 501us (6024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428014.033577:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428014.033700:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789428014.033751:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877142656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789428014.932004:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789428015.569121:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428015.569130:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789428015.569135:0:8:0:(import.c:65:import_set_state_nolock()) ffff9334089bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428015.569160:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9334089bb000 using connection 192.168.201.155@tcp/0@lo 00000100:00100000:2.0:1789428015.569262:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93330387d180 x1876350877143040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789428015.569342:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877142784:0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.569437:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428015.569495:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877143424:0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.569532:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428015.569566:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789428015.569572:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877142912:0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.569598:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428015.569626:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877143040:0@lo:8:kworker.0 00000100:00100000:2.0:1789428015.569656:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428015.569697:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877143168:0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.569734:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428015.569754:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789428015.569760:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877143296:0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.569782:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428015.569818:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877142784 00000100:00100000:2.0:1789428015.569828:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877142784 00000100:00100000:2.0:1789428015.570041:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789428015.570056:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3298:x1876350877142784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.570120:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3298:x1876350877142784:12345-0@lo:400:kworker.0 Request processed in 67us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428015.570127:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789428015.570165:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877143424 00000100:00100000:2.0:1789428015.570169:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877143424 00000100:00100000:2.0:1789428015.570223:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877143168 00000100:00100000:2.0:1789428015.570227:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877143168 00000100:00100000:2.0:1789428015.570237:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877143296 00000100:00100000:2.0:1789428015.570239:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877143296 00000100:00100000:2.0:1789428015.570251:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789428015.570256:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877143424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.570286:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877143424:12345-0@lo:400:kworker.0 Request processed in 30us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428015.570292:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789428015.570301:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789428015.570305:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877143168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.570327:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877143168:12345-0@lo:400:kworker.0 Request processed in 22us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428015.570332:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789428015.570341:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789428015.570345:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877143296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.570369:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877143296:12345-0@lo:400:kworker.0 Request processed in 23us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428015.570374:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789428015.570395:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877142912 00000100:00100000:2.0:1789428015.570406:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877142912 00000100:00100000:2.0:1789428015.570433:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877143040 00000100:00100000:2.0:1789428015.570437:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877143040 00000100:00100000:2.0:1789428015.570447:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428015.570453:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877142912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.570486:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877142912:12345-0@lo:400:kworker.0 Request processed in 33us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428015.570493:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428015.570504:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428015.570508:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1876350877143040:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789428015.570540:0:15057:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1789428015.570582:0:15057:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bea1a57ca3445e4 00002000:00100000:2.0:1789428015.570599:0:15057:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9334335f6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789428015.570604:0:15057:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789428015.570609:0:15057:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789428015.580359:0:15057:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789428015.580417:0:15057:0:(import.c:65:import_set_state_nolock()) ffff9334335f3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428015.580566:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1876350877143040:12345-0@lo:8:kworker.0 Request processed in 10053us (10906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428015.580580:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428015.580696:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877142912:0@lo:400:kworker.0 00000100:00100000:2.0:1789428015.580725:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877142784:0@lo:400:kworker.0 00010000:00080000:2.0:1789428015.580743:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93330387dc00 x1876350877143424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428015.580755:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877143424:0@lo:400:kworker.0 00000100:00080000:2.0:1789428015.580812:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789428015.580841:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93330387c000 x1876350877143296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428015.580851:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877143296:0@lo:400:kworker.0 00010000:00080000:2.0:1789428015.580865:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93330387d500 x1876350877143168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428015.580873:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877143168:0@lo:400:kworker.0 00010000:00080000:2.0:1789428015.589498:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93330387d180 x1876350877143040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789428040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789428015.589534:0:3297:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789428015.589547:0:3297:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789428015.589557:0:3297:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789428015.589561:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9334089bb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789428015.589597:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789428015.589606:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1876350877143040:0@lo:8:kworker.0 00000004:00080000:0.0:1789428015.593089:0:14393:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789428015.593131:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1876350877143680:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789428015.593406:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428015.593447:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff93343a8c5180 going to sleep for 11 seconds 00000004:00080000:0.0:1789428015.593475:0:14392:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789428015.594143:0:14392:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 470528965884ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789428015.594641:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789428015.594664:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877143552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789428015.594735:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428015.595051:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877143680 00000100:00100000:0.0:1789428015.595063:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877143680 00000100:00100000:0.0:1789428015.595139:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428015.595152:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14393:x1876350877143680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789428015.604435:0:15057:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789428015.604453:0:15057:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789428015.604460:0:15057:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:1.0:1789428015.605845:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877143552 00000100:00100000:1.0:1789428015.605869:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877143552 00000100:00100000:1.0:1789428015.605977:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428015.605991:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1876350877143552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789428015.606046:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789428015.606304:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1876350877143552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 316us (11568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428015.606312:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789428015.622377:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93343f994700 x1876350877143552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789428031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428015.622413:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877143552:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789428015.622464:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789428015.627820:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428015.627834:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.627858:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1789428015.627865:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428015.627873:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628087:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628102:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628110:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628136:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789428015.628154:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428015.628161:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628169:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428015.628207:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628218:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628239:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628248:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2402cad/0x2bea1a57ca3445eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628277:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.628280:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.628281:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428015.628862:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428015.628870:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628882:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1789428015.628886:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428015.628892:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628915:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628926:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628934:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628960:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789428015.628972:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428015.628977:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.628997:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428015.629001:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629012:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629026:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629033:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb11a/0x2bea1a57ca3445f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629048:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.629050:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.629052:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428015.629500:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428015.629507:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629517:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1789428015.629520:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428015.629525:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629535:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629550:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629558:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629572:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789428015.629581:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428015.629586:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629593:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428015.629596:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629604:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629616:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629624:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042fd3d6b/0x2bea1a57ca3445f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.629637:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.629644:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.629646:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428015.630051:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789428015.630058:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.630068:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1789428015.630072:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428015.630076:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.630087:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.630095:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.630104:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.630119:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789428015.630127:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428015.630131:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.630139:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428015.630142:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.630163:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789428015.631361:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.631373:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631393:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.631397:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.631403:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631417:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631428:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631436:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631454:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428015.631882:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.631890:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631898:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.631901:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.631905:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631915:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631935:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631943:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.631952:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789428015.632395:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.632403:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.632414:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.632417:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.632422:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.632431:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.632439:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.632448:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.632467:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789428015.639800:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639827:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef255f3/0x2bea1a57ca344600 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639859:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789428015.639866:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639874:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179c00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428015.639880:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639892:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639914:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639922:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d156d7db/0x2bea1a57ca344607 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639957:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428015.639961:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639969:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428015.639972:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639980:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639992:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.639999:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad4eed65/0x2bea1a57ca34460e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.640012:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428015.640016:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.640023:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428015.640026:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.640046:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.640057:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.640064:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba351fa2/0x2bea1a57ca344615 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.640076:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.640078:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.640081:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.640096:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.643141:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.643163:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643273:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.643279:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.643287:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643306:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643318:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643328:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643357:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.643383:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.643389:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643397:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178c00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.643410:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643420:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643438:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643446:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca34461c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.643468:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.643470:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.643471:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.647566:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.647585:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.647608:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.647614:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.647622:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.647640:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.647653:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.647670:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.647694:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789428015.648055:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428015.648064:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.648073:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:1.0:1789428015.648078:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.648088:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.648113:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.648129:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c0c8e2/0x2bea1a57ca344623 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428015.649435:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.649441:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.649444:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.659388:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.659404:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659427:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.659433:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.659441:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659458:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659469:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659479:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659497:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.659511:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.659519:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659537:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178a00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.659543:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659553:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659573:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659582:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce2435e6/0x2bea1a57ca34462a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.659604:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.659606:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.659608:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.660152:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.660161:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660172:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.660221:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.660226:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660237:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660255:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660263:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660286:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428015.660738:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.660744:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660753:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.660757:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.660761:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660770:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660779:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660787:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660811:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789428015.660825:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428015.660830:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660836:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e179e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.660841:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660851:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660864:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660872:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a315b4b5/0x2bea1a57ca344631 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660888:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.660891:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660897:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178c00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.660900:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660919:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660929:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660937:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f994faf/0x2bea1a57ca344638 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.660951:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.660952:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.660953:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.661410:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.661418:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661427:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.661431:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.661435:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661444:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661452:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661465:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661485:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.661497:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.661501:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661508:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.661512:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661520:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661532:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661540:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000474d17de/0x2bea1a57ca34463f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.661554:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.661556:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.661557:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.662711:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.662731:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662747:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.662751:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.662757:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662770:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662782:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662790:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662812:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.662830:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.662835:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662844:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93341e178e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.662848:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662858:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662878:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662886:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0d35481/0x2bea1a57ca344646 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.662914:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.662916:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.662918:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.663403:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.663410:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663418:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.663422:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.663426:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663436:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663460:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663467:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663495:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.663507:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.663511:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663518:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.663522:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663531:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663544:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663552:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca34464d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.663567:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.663568:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.663570:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.664020:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.664029:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664039:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.664049:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.664054:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664064:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664074:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664083:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664100:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.664109:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.664113:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664120:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.664123:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664131:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664143:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664161:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca344654 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664203:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.664205:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.664207:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.664681:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.664689:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664709:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.664713:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.664718:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664728:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664737:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664744:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664767:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.664777:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.664788:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664796:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.664799:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664809:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664820:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664829:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca34465b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.664844:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.664846:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.664848:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.665306:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.665314:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665323:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.665325:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.665329:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665351:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665359:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665365:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665380:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.665388:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.665391:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665397:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998c00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.665400:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665406:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665415:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665423:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344662 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.665443:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.665445:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.665447:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428015.666710:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.680830:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.680851:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.680874:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.680879:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.680888:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.682029:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.682056:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.682065:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.682096:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.682118:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.682125:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.682146:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.682151:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.682161:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.682210:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.682218:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca344669 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.682246:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.682248:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.682250:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.685131:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.685152:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.685188:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.685202:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.685210:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.685227:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.685250:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.685258:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.685287:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428015.686042:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428015.686053:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428015.686077:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998c00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428015.686083:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428015.686095:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428015.686121:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428015.686128:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b99c6d/0x2bea1a57ca344670 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428015.686150:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428015.686152:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428015.686154:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.689633:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.689655:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.689679:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.689685:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.689692:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.690219:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.690233:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.690242:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.690275:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.690293:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.690300:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.690308:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.690314:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.690324:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.690348:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.690356:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca344677 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.690379:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.690381:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.690383:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.691080:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.691089:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691101:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.691113:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.691118:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691128:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691137:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691144:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691162:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428015.691626:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.691632:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691641:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.691644:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.691649:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691659:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691668:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691682:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691709:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789428015.691723:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428015.691728:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691737:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.691742:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691751:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691766:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691773:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed39adee/0x2bea1a57ca34467e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691789:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.691792:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691810:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.691814:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691822:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691832:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691840:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cea02582/0x2bea1a57ca344685 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.691854:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.691856:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.691858:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.692323:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.692330:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692341:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.692344:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.692349:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692358:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692373:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692380:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692397:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.692406:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.692410:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692416:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999a00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.692420:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692428:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692439:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692446:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d39f548a/0x2bea1a57ca34468c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692459:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.692466:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.692468:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.692918:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.692924:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692934:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.692937:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.692942:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692951:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692959:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692967:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.692982:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.692991:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.692995:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693002:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.693006:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693027:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693039:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693048:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c60dc3be/0x2bea1a57ca344693 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693063:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.693065:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.693067:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428015.693551:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.693559:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693568:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.693571:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.693575:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693585:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693593:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693612:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693626:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428015.693636:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428015.693639:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693647:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999200 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428015.693650:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693657:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693669:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693677:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aa0d9c8/0x2bea1a57ca34469a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.693691:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.693692:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.693694:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428015.693975:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789428015.695133:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:3.0:1789428015.698830:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1789428015.700164:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.700481:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.700504:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.700511:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.700519:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.700537:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.700549:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.700557:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.701999:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428015.702798:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789428015.702810:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.702831:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789428015.702836:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428015.702843:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.702860:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.702880:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428015.702888:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707042:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428015.707068:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707118:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428015.707124:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707139:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707186:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707196:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ec3ffa3/0x2bea1a57ca3446a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707236:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428015.707241:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707248:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428015.707251:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707259:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707269:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428015.707283:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428015.707285:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428015.707287:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428015.710168:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789428015.710207:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020528986/0x2bea1a57ca3446a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789428015.710885:0:15057:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:1.0:1789428015.713071:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428015.714914:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14393:x1876350877143680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 119740us (121484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428015.714931:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428015.715030:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1876350877143680:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789428015.715055:0:14393:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789428015.715124:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1876350877143808:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789428015.715168:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428015.715247:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410cfd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789428015.715269:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877143808 00000100:00100000:0.0:1789428015.715277:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877143808 00000100:00100000:0.0:1789428015.715328:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789428015.715337:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14393:x1876350877143808:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789428015.715396:0:15057:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1789428015.722327:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14393:x1876350877143808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6978us (7145us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789428015.722344:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428015.722508:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343f995c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1876350877143808:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789428015.722529:0:14393:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1789428015.945413:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789428016.780981:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789428016.969436:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428017.995014:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789428018.557680:0:16130:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789428019.020603:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428019.145592:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789428019.145623:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877143936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789428019.145729:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428019.145860:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877143936 00000100:00100000:1.0:1789428019.145872:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877143936 00000100:00100000:1.0:1789428019.145955:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428019.145966:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877143936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789428019.146011:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789428019.146070:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877143936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428019.146077:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428019.146135:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877143936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789428019.146390:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789428020.044816:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428020.691836:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:92161c2e-b691-4539-8b6b-a6d322602ab0:3301:1876350877144064:0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.691937:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428020.691992:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877144576:0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.692023:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428020.692053:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789428020.692058:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877144448:0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.692077:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428020.692113:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877144192:0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.692142:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428020.692160:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877144704:0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.692218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428020.692236:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789428020.692242:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877144320:0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.692263:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428020.692299:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877144064 00000100:00100000:2.0:1789428020.692308:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877144064 00000100:00100000:2.0:1789428020.692365:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789428020.692375:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3301:x1876350877144064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.692433:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3301:x1876350877144064:12345-0@lo:400:kworker.0 Request processed in 59us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428020.692460:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789428020.695747:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877144448 00000100:00100000:2.0:1789428020.695767:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877144448 00000100:00100000:2.0:1789428020.695821:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877144704 00000100:00100000:2.0:1789428020.695825:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877144704 00000100:00100000:2.0:1789428020.695873:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789428020.695885:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877144448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.695993:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877144448:12345-0@lo:400:kworker.0 Request processed in 110us (3914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428020.696002:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789428020.696022:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789428020.696029:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877144704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.696060:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877144704:12345-0@lo:400:kworker.0 Request processed in 32us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428020.696066:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789428020.696089:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877144192 00000100:00100000:2.0:1789428020.696093:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877144192 00000100:00100000:2.0:1789428020.696121:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877144320 00000100:00100000:2.0:1789428020.696124:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877144320 00000100:00100000:2.0:1789428020.696143:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789428020.696149:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877144192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.696207:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877144192:12345-0@lo:400:kworker.0 Request processed in 57us (4064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428020.696213:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789428020.696225:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789428020.696231:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877144320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.696283:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1876350877144320:12345-0@lo:400:kworker.0 Request processed in 52us (4018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428020.696290:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789428020.696343:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93330387dc00 x1876350877144448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428020.696362:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877144448:0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.696375:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:92161c2e-b691-4539-8b6b-a6d322602ab0:3301:1876350877144064:0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.696421:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877144832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789428020.696462:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428020.696517:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877144320:0@lo:400:kworker.0 00000100:00100000:2.0:1789428020.696529:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877144192:0@lo:400:kworker.0 00010000:00080000:2.0:1789428020.696541:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93330387f100 x1876350877144704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428020.696552:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877144704:0@lo:400:kworker.0 00000100:00080000:2.0:1789428020.697653:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789428020.697668:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789428020.697701:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877144832 00000100:00100000:2.0:1789428020.697710:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877144832 00000100:00100000:2.0:1789428020.697763:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428020.697772:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877144832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789428020.697809:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789428020.697888:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876350877144832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428020.697908:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428020.697965:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877144832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789428020.699000:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877144576 00000100:00100000:0.0:1789428020.699014:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877144576 00000100:00080000:0.0:1789428020.699053:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789428020.699119:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789428020.699130:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877144576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428020.699230:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877144576:12345-0@lo:400:kworker.0 Request processed in 103us (7206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428020.699237:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789428020.699284:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93330387f800 x1876350877144576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428020.699300:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877144576:0@lo:400:kworker.0 00000001:00080000:3.0:1789428020.869308:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1789428021.068311:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428021.580205:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428021.580330:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857224704 00000100:00100000:3.0:1789428021.580345:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857224704 00000100:00100000:3.0:1789428021.580395:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 75 00000100:00100000:3.0:1789428021.580405:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1876350857224704:12345-192.168.201.55@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789428021.580439:0:14361:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 335f5f6b-62a5-411c-9395-a123e708efa6@192.168.201.55@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:3.0:1789428021.580499:0:14361:0:(genops.c:1384:class_connect()) connect: client 335f5f6b-62a5-411c-9395-a123e708efa6, cookie 0x2bea1a57ca3446af 00000100:00080000:3.0:1789428021.580682:0:14361:0:(import.c:65:import_set_state_nolock()) ffff9334201c6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428021.581326:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+5:2353:x1876350857224704:12345-192.168.201.55@tcp:250:mount.lustre.0 Request processed in 915us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428021.581337:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 75 00000100:00100000:0.0:1789428021.598222:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428021.598900:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857224832 00000100:00100000:2.0:1789428021.598915:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857224832 00000100:00100000:2.0:1789428021.598994:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 76 00000100:00100000:2.0:1789428021.599007:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+5:13726:x1876350857224832:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789428021.599033:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428021.599059:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93340e1d4c00/0x2bea1a57ca3446b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8ad0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428021.599099:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93340e1d4c00/0x2bea1a57ca3446b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ad0 expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428021.599113:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93340e1d4c00/0x2bea1a57ca3446b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ad0 expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428021.599124:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4c00, rc 0) 00000100:00100000:2.0:1789428021.599234:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+6:13726:x1876350857224832:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 228us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428021.599242:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 76 00000100:00100000:1.0:1789428021.618969:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428021.619026:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857224960 00000100:00100000:1.0:1789428021.619039:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857224960 00000100:00100000:1.0:1789428021.619114:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 77 00000100:00100000:1.0:1789428021.619125:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+6:13726:x1876350857224960:12345-192.168.201.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789428021.619708:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+6:13726:x1876350857224960:12345-192.168.201.55@tcp:501:mount.lustre.0 Request processed in 579us (748us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789428021.619720:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 77 00000100:00100000:3.0:1789428021.651093:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428021.651302:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857225088 00000100:00100000:0.0:1789428021.651315:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857225088 00000100:00100000:0.0:1789428021.651388:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 78 00000100:00100000:0.0:1789428021.651401:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+6:13726:x1876350857225088:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789428021.651425:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428021.651451:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933301999c00/0x2bea1a57ca3446bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8ad7 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428021.651509:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933301999c00/0x2bea1a57ca3446bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ad7 expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428021.651525:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933301999c00/0x2bea1a57ca3446bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ad7 expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428021.651538:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301999c00, rc 0) 00000100:00100000:0.0:1789428021.651651:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+7:13726:x1876350857225088:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 251us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428021.651660:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 78 00000100:00100000:0.0:1789428021.655360:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428021.656358:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857225216 00000100:00100000:1.0:1789428021.656375:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857225216 00000100:00100000:1.0:1789428021.656446:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 79 00000100:00100000:1.0:1789428021.656459:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+7:13726:x1876350857225216:12345-192.168.201.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789428021.656929:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+8:13726:x1876350857225216:12345-192.168.201.55@tcp:501:mount.lustre.0 Request processed in 471us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428021.656939:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 79 00000100:00100000:1.0:1789428021.663979:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428021.664952:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857225344 00000100:00100000:3.0:1789428021.664971:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857225344 00000100:00100000:3.0:1789428021.665042:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 80 00000100:00100000:3.0:1789428021.665055:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93340f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+8:13726:x1876350857225344:12345-192.168.201.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789428021.665723:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93340f0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+8:13726:x1876350857225344:12345-192.168.201.55@tcp:503:mount.lustre.0 Request processed in 664us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428021.665733:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 80 00000100:00100000:3.0:1789428021.673573:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428021.683077:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857225472 00000100:00100000:1.0:1789428021.683169:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857225472 00000100:00100000:1.0:1789428021.683396:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 81 00000100:00100000:1.0:1789428021.683409:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+8:13744:x1876350857225472:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428021.684437:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+8:13744:x1876350857225472:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 1021us (10867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428021.684450:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 81 00000100:00100000:0.0:1789428021.720490:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428021.721006:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857225600 00000100:00100000:3.0:1789428021.721021:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857225600 00000100:00100000:3.0:1789428021.721102:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 82 00000100:00100000:3.0:1789428021.721113:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+8:13744:x1876350857225600:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428021.721937:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+8:13744:x1876350857225600:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 819us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428021.721949:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 82 00000100:00100000:2.0:1789428021.745704:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428021.746360:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857225728 00000100:00100000:0.0:1789428021.746375:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857225728 00000100:00100000:0.0:1789428021.746463:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 83 00000100:00100000:0.0:1789428021.746476:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+8:13726:x1876350857225728:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789428021.746501:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428021.746524:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933301998000/0x2bea1a57ca3446c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8b01 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428021.746560:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933301998000/0x2bea1a57ca3446c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b01 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428021.746572:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933301998000/0x2bea1a57ca3446c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b01 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428021.746582:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301998000, rc 0) 00000100:00100000:0.0:1789428021.746695:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+9:13726:x1876350857225728:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 222us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428021.746704:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 83 00000100:00100000:1.0:1789428021.756790:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428021.756984:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857225856 00000100:00100000:3.0:1789428021.756998:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857225856 00000100:00100000:3.0:1789428021.757070:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 84 00000100:00100000:3.0:1789428021.757083:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+9:13726:x1876350857225856:12345-192.168.201.55@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789428021.757151:0:14363:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789428021.757218:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789428021.757223:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789428021.757227:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789428021.757237:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789428021.766561:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+9:13726:x1876350857225856:12345-192.168.201.55@tcp:256:mount.lustre.0 Request processed in 9461us (9766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428021.766581:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 84 00000100:00100000:2.0:1789428021.777883:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428021.777996:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857225984 00000100:00100000:3.0:1789428021.778012:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857225984 00000100:00100000:3.0:1789428021.778089:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 85 00000100:00100000:3.0:1789428021.778103:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+9:13726:x1876350857225984:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789428021.778128:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428021.778156:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8b08 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428021.778383:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b08 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428021.778399:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b08 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428021.778413:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030e00, rc 0) 00000100:00100000:3.0:1789428021.778619:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+10:13726:x1876350857225984:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 516us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428021.778627:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 85 00000100:00100000:2.0:1789428021.786325:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428021.786466:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857226112 00000100:00100000:3.0:1789428021.786482:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857226112 00000100:00100000:3.0:1789428021.786557:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 86 00000100:00100000:3.0:1789428021.786571:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+10:13726:x1876350857226112:12345-192.168.201.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789428021.790329:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+10:13726:x1876350857226112:12345-192.168.201.55@tcp:501:mount.lustre.0 Request processed in 3744us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428021.790348:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 86 00000100:00100000:0.0:1789428021.792740:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428021.794435:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857226240 00000100:00100000:1.0:1789428021.794468:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857226240 00000100:00100000:1.0:1789428021.794562:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 87 00000100:00100000:1.0:1789428021.794575:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+10:13726:x1876350857226240:12345-192.168.201.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789428021.795083:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+10:13726:x1876350857226240:12345-192.168.201.55@tcp:503:mount.lustre.0 Request processed in 509us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428021.795093:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 87 00000100:00100000:2.0:1789428021.803136:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428021.803348:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857226368 00000100:00100000:3.0:1789428021.803362:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857226368 00000100:00100000:3.0:1789428021.806017:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 88 00000100:00100000:3.0:1789428021.806049:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+10:13748:x1876350857226368:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428021.806529:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+10:13748:x1876350857226368:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 495us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428021.806539:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 88 00000100:00100000:2.0:1789428021.817674:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428021.817770:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857226496 00000100:00100000:1.0:1789428021.817783:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857226496 00000100:00100000:1.0:1789428021.817853:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 89 00000100:00100000:1.0:1789428021.817866:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+10:13748:x1876350857226496:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428021.819838:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+10:13748:x1876350857226496:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 1959us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428021.819858:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 89 00000100:00100000:0.0:1789428021.830810:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428021.831113:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857226624 00000100:00100000:2.0:1789428021.831129:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857226624 00000100:00100000:2.0:1789428021.831238:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:2.0:1789428021.831249:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1876350857226624:12345-192.168.201.55@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789428021.831293:0:14370:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 10605fa2-3254-437c-8111-34c57e564568@192.168.201.55@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:2.0:1789428021.831358:0:14370:0:(genops.c:1384:class_connect()) connect: client 10605fa2-3254-437c-8111-34c57e564568, cookie 0x2bea1a57ca3446d2 00000004:00100000:2.0:1789428021.831403:0:14370:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789428021.831411:0:14370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789428021.864259:0:14370:0:(import.c:65:import_set_state_nolock()) ffff9334335f0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428021.864358:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+6:2353:x1876350857226624:12345-192.168.201.55@tcp:38:mount.lustre.0 Request processed in 33107us (33561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428021.864372:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:2.0:1789428021.875036:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428021.875337:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428021.875446:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857226752 00000100:00100000:0.0:1789428021.875461:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857226752 00000100:00100000:0.0:1789428021.875543:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857226880 00000100:00100000:0.0:1789428021.875547:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857226880 00000100:00100000:0.0:1789428021.875567:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:0.0:1789428021.875578:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+7:0:x1876350857226752:12345-192.168.201.55@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789428021.875651:0:14369:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789428021.875746:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+7:0:x1876350857226752:12345-192.168.201.55@tcp:41:mount.lustre.0 Request processed in 170us (723us total) trans 0 rc 0/0 00000100:00080000:3.0:1789428021.875864:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789428021.876475:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:0.0:1789428021.876504:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:0.0:1789428021.876513:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+6:13726:x1876350857226880:12345-192.168.201.55@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789428021.876534:0:14369:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789428021.876602:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+6:13726:x1876350857226880:12345-192.168.201.55@tcp:41:mount.lustre.0 Request processed in 87us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428021.876609:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:3.0:1789428021.878446:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428021.878604:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857227008 00000100:00100000:2.0:1789428021.878620:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857227008 00000100:00100000:2.0:1789428021.878902:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:2.0:1789428021.878915:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+6:13726:x1876350857227008:12345-192.168.201.55@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789428021.879097:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+6:13726:x1876350857227008:12345-192.168.201.55@tcp:40:mount.lustre.0 Request processed in 184us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428021.879105:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:2.0:1789428021.884650:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428021.884692:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428021.884730:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857227136 00000100:00100000:2.0:1789428021.884732:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428021.884745:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857227136 00000100:00100000:0.0:1789428021.884809:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857227264 00000100:00100000:0.0:1789428021.884813:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857227264 00000100:00100000:0.0:1789428021.884831:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:0.0:1789428021.884840:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876350857227136:12345-192.168.201.55@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789428021.884891:0:15055:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 10605fa2-3254-437c-8111-34c57e564568@192.168.201.55@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1789428021.884929:0:15055:0:(genops.c:1384:class_connect()) connect: client 10605fa2-3254-437c-8111-34c57e564568, cookie 0x2bea1a57ca3446d9 00002000:00100000:0.0:1789428021.884941:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10605fa2-3254-437c-8111-34c57e564568/ffff933406acd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789428021.884970:0:15055:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789428021.885142:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857227392 00000100:00100000:1.0:1789428021.885146:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857227392 00000100:00100000:1.0:1789428021.885226:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:1.0:1789428021.885234:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+6:13726:x1876350857227392:12345-192.168.201.55@tcp:33:mount.lustre.0 00002000:00080000:0.0:1789428021.886960:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789428021.887018:0:15055:0:(import.c:65:import_set_state_nolock()) ffff933406acf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428021.887338:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10605fa2-3254-437c-8111-34c57e564568+6:2353:x1876350857227136:12345-192.168.201.55@tcp:8:mount.lustre.0 Request processed in 2494us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428021.887352:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:0.0:1789428021.887531:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:0.0:1789428021.887540:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876350857227264:12345-192.168.201.55@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789428021.887573:0:15055:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 10605fa2-3254-437c-8111-34c57e564568@192.168.201.55@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1789428021.887619:0:15055:0:(genops.c:1384:class_connect()) connect: client 10605fa2-3254-437c-8111-34c57e564568, cookie 0x2bea1a57ca3446e0 00002000:00100000:0.0:1789428021.887633:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10605fa2-3254-437c-8111-34c57e564568/ffff933406aca800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789428021.887646:0:15055:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789428021.887946:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789428021.887971:0:15055:0:(import.c:65:import_set_state_nolock()) ffff933406aca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428021.888005:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10605fa2-3254-437c-8111-34c57e564568+6:2353:x1876350857227264:12345-192.168.201.55@tcp:8:mount.lustre.0 Request processed in 464us (3311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428021.888011:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 9 00000004:00080000:2.0:1789428021.889628:0:14371:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4314us 00000004:00200000:3.0:1789428021.916050:0:14371:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789428021.916472:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+6:13726:x1876350857227392:12345-192.168.201.55@tcp:33:mount.lustre.0 Request processed in 31228us (31729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428021.916491:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 0 00010000:00010000:3.0:1789428022.089539:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428022.190367:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428022.194652:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857227520 00000100:00100000:0.0:1789428022.194677:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857227520 00000100:00100000:0.0:1789428022.194867:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:0.0:1789428022.194882:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+6:13769:x1876350857227520:12345-192.168.201.55@tcp:101:mkdir.0 00010000:00010000:0.0:1789428022.194931:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428022.194980:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3446e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8b32 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428022.195072:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3446ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428022.195100:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3446ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428022.195120:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3446ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428022.195168:0:14369:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789428022.195172:0:14369:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789428022.195272:0:14369:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3446ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428022.195303:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3446e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b32 expref: 8 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428022.195326:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3446ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b32 expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428022.195335:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9000) 00010000:00010000:0.0:1789428022.195338:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428022.195343:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301998a00, rc 0) 00000100:00100000:0.0:1789428022.195456:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+7:13769:x1876350857227520:12345-192.168.201.55@tcp:101:mkdir.0 Request processed in 577us (5102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428022.195473:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00000001:00100000:3.0:1789428022.778825:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10605fa2-3254-437c-8111-34c57e564568 00010000:00010000:1.0:1789428023.115536:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428024.137651:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428024.265485:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789428024.265518:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877144960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428024.265627:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428024.265799:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877144960 00000100:00100000:1.0:1789428024.265811:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877144960 00000100:00100000:1.0:1789428024.265907:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789428024.265918:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877144960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789428024.265969:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789428024.266028:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877144960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428024.266035:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789428024.266208:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789428024.266254:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877144960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789428024.425871:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428024.426072:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857227648 00000100:00100000:0.0:1789428024.426089:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857227648 00000100:00100000:0.0:1789428024.426227:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:0.0:1789428024.426241:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+7:13821:x1876350857227648:12345-192.168.201.55@tcp:41:lfs.0 00000004:00000024:0.0:1789428024.426304:0:14370:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789428024.426433:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+7:13821:x1876350857227648:12345-192.168.201.55@tcp:41:lfs.0 Request processed in 194us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428024.426441:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00080000:3.0:1789428024.426652:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428024.431534:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428024.432349:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857227776 00000100:00100000:1.0:1789428024.432365:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857227776 00000100:00100000:1.0:1789428024.432491:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:1.0:1789428024.432504:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10605fa2-3254-437c-8111-34c57e564568+5:13821:x1876350857227776:12345-192.168.201.55@tcp:13:lfs.0 00002000:00000024:1.0:1789428024.432553:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789428024.432690:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10605fa2-3254-437c-8111-34c57e564568+5:13821:x1876350857227776:12345-192.168.201.55@tcp:13:lfs.0 Request processed in 188us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428024.432699:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00080000:3.0:1789428024.433159:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428024.436124:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428024.436399:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857227904 00000100:00100000:1.0:1789428024.436425:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857227904 00000100:00100000:1.0:1789428024.436925:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:1.0:1789428024.436948:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10605fa2-3254-437c-8111-34c57e564568+6:13821:x1876350857227904:12345-192.168.201.55@tcp:13:lfs.0 00002000:00000024:1.0:1789428024.437008:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789428024.437385:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789428024.438468:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10605fa2-3254-437c-8111-34c57e564568+6:13821:x1876350857227904:12345-192.168.201.55@tcp:13:lfs.0 Request processed in 1517us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428024.438483:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:0.0:1789428024.684371:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428024.684558:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857228032 00000100:00100000:3.0:1789428024.684574:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857228032 00000100:00100000:3.0:1789428024.684648:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 90 00000100:00100000:3.0:1789428024.684661:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+10:13853:x1876350857228032:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789428024.684685:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428024.684708:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933400030200/0x2bea1a57ca3446f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8b39 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428024.684746:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933400030200/0x2bea1a57ca3446f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b39 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428024.684760:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933400030200/0x2bea1a57ca3446f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b39 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428024.684770:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933400030200, rc 0) 00000100:00100000:3.0:1789428024.684859:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+11:13853:x1876350857228032:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 200us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428024.684866:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 90 00000100:00100000:3.0:1789428024.692284:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428024.695979:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857228160 00000100:00100000:1.0:1789428024.696003:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857228160 00000100:00100000:1.0:1789428024.696941:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 91 00000100:00100000:1.0:1789428024.696962:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+11:13853:x1876350857228160:12345-192.168.201.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789428024.697632:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+11:13853:x1876350857228160:12345-192.168.201.55@tcp:501:mount.lustre.0 Request processed in 672us (5358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428024.697644:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 91 00000100:00100000:1.0:1789428024.711109:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428024.712430:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857228288 00000100:00100000:2.0:1789428024.712450:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857228288 00000100:00100000:2.0:1789428024.712549:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 92 00000100:00100000:2.0:1789428024.712562:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+11:13853:x1876350857228288:12345-192.168.201.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789428024.712979:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+11:13853:x1876350857228288:12345-192.168.201.55@tcp:503:mount.lustre.0 Request processed in 418us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428024.712990:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 92 00000100:00100000:0.0:1789428024.716373:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428024.716667:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857228416 00000100:00100000:1.0:1789428024.716682:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857228416 00000100:00100000:1.0:1789428024.716753:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 93 00000100:00100000:1.0:1789428024.716766:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+11:13860:x1876350857228416:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428024.717339:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+11:13860:x1876350857228416:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 572us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428024.717350:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 93 00000100:00100000:0.0:1789428024.734901:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428024.737919:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857228544 00000100:00100000:3.0:1789428024.738083:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857228544 00000100:00100000:3.0:1789428024.738579:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 94 00000100:00100000:2.0:1789428024.740305:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+11:13860:x1876350857228544:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789428024.740745:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+11:13860:x1876350857228544:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 2153us (6353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428024.745620:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428024.746132:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857228672 00000100:00100000:0.0:1789428024.746146:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857228672 00000100:00100000:0.0:1789428024.746235:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 95 00000100:00100000:0.0:1789428024.746247:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+12:13853:x1876350857228672:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789428024.746270:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428024.746294:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933301998600/0x2bea1a57ca3446fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8b63 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428024.746326:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933301998600/0x2bea1a57ca3446fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b63 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428024.746338:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933301998600/0x2bea1a57ca3446fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b63 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428024.746349:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301998600, rc 0) 00000100:00100000:2.0:1789428024.747022:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 94 00000100:00100000:0.0:1789428024.747390:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+12:13853:x1876350857228672:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 1142us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428024.747499:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 95 00000100:00100000:0.0:1789428024.753076:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428024.757127:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857228800 00000100:00100000:2.0:1789428024.757149:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857228800 00000100:00100000:2.0:1789428024.757257:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 96 00000100:00100000:2.0:1789428024.757269:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+12:13853:x1876350857228800:12345-192.168.201.55@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789428024.757303:0:14363:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789428024.757336:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789428024.757341:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789428024.757345:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789428024.757347:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789428024.767509:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+12:13853:x1876350857228800:12345-192.168.201.55@tcp:256:mount.lustre.0 Request processed in 10222us (14426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428024.767553:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 96 00000100:00100000:3.0:1789428024.771607:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428024.772402:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857228928 00000100:00100000:0.0:1789428024.772419:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857228928 00000100:00100000:0.0:1789428024.772549:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 97 00000100:00100000:0.0:1789428024.772563:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+12:13853:x1876350857228928:12345-192.168.201.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789428024.772586:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428024.772613:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8b6a expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428024.772651:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b6a expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428024.772665:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b6a expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428024.772675:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301999600, rc 0) 00000100:00100000:0.0:1789428024.772767:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+13:13853:x1876350857228928:12345-192.168.201.55@tcp:101:mount.lustre.0 Request processed in 208us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428024.772775:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 97 00000100:00100000:0.0:1789428024.775429:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428024.775505:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857229056 00000100:00100000:2.0:1789428024.775520:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857229056 00000100:00100000:2.0:1789428024.775599:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 98 00000100:00100000:2.0:1789428024.775612:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+13:13853:x1876350857229056:12345-192.168.201.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789428024.776149:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+13:13853:x1876350857229056:12345-192.168.201.55@tcp:501:mount.lustre.0 Request processed in 536us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428024.776159:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 98 00000100:00100000:3.0:1789428024.778857:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428024.778981:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857229184 00000100:00100000:0.0:1789428024.778996:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857229184 00000100:00100000:0.0:1789428024.779069:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 99 00000100:00100000:0.0:1789428024.779082:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+13:13853:x1876350857229184:12345-192.168.201.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789428024.782451:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+13:13853:x1876350857229184:12345-192.168.201.55@tcp:503:mount.lustre.0 Request processed in 2552us (2788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428024.782476:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 99 00000100:00100000:3.0:1789428024.787785:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428024.787915:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857229312 00000100:00100000:1.0:1789428024.787935:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857229312 00000100:00100000:1.0:1789428024.788025:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 100 00000100:00100000:1.0:1789428024.788049:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+13:13864:x1876350857229312:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428024.788454:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+13:13864:x1876350857229312:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 408us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428024.788464:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 100 00000100:00100000:2.0:1789428024.798388:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428024.798575:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857229440 00000100:00100000:0.0:1789428024.798588:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857229440 00000100:00100000:0.0:1789428024.798670:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 101 00000100:00100000:0.0:1789428024.798683:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+13:13864:x1876350857229440:12345-192.168.201.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789428024.799709:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+13:13864:x1876350857229440:12345-192.168.201.55@tcp:502:llog_process_th.0 Request processed in 1018us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428024.799723:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 101 00000100:00100000:3.0:1789428024.816411:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428024.816471:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857229568 00000100:00100000:0.0:1789428024.816487:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857229568 00000100:00100000:0.0:1789428024.816566:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:0.0:1789428024.816578:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1876350857229568:12345-192.168.201.55@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789428024.816620:0:14369:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 3dd2c17e-239c-4cc3-a060-6d9ba67df7be@192.168.201.55@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1789428024.816939:0:14369:0:(genops.c:1384:class_connect()) connect: client 3dd2c17e-239c-4cc3-a060-6d9ba67df7be, cookie 0x2bea1a57ca34470a 00000004:00100000:0.0:1789428024.816984:0:14369:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789428024.817276:0:14369:0:(import.c:65:import_set_state_nolock()) ffff93343c8dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428024.817612:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2353:x1876350857229568:12345-192.168.201.55@tcp:38:mount.lustre.0 Request processed in 1033us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428024.817623:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:3.0:1789428024.823059:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428024.823112:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428024.823280:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857229696 00000100:00100000:1.0:1789428024.823294:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857229696 00000100:00100000:1.0:1789428024.823383:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857229824 00000100:00100000:1.0:1789428024.823387:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857229824 00000100:00100000:1.0:1789428024.823418:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:1.0:1789428024.823429:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+7:0:x1876350857229696:12345-192.168.201.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789428024.823473:0:14368:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789428024.823591:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+7:0:x1876350857229696:12345-192.168.201.55@tcp:41:mount.lustre.0 Request processed in 162us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428024.823598:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:1.0:1789428024.823619:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:1.0:1789428024.823626:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:13853:x1876350857229824:12345-192.168.201.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789428024.823638:0:14368:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789428024.823661:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:13853:x1876350857229824:12345-192.168.201.55@tcp:41:mount.lustre.0 Request processed in 35us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428024.823690:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00080000:3.0:1789428024.824586:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789428024.831378:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428024.831645:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857229952 00000100:00100000:0.0:1789428024.831662:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857229952 00000100:00100000:0.0:1789428024.831757:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:0.0:1789428024.831770:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:13853:x1876350857229952:12345-192.168.201.55@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789428024.831972:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:13853:x1876350857229952:12345-192.168.201.55@tcp:40:mount.lustre.0 Request processed in 160us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428024.831981:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:0.0:1789428024.844394:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428024.844447:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428024.844581:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857230080 00000100:00100000:2.0:1789428024.844595:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857230080 00000100:00100000:2.0:1789428024.844645:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857230208 00000100:00100000:2.0:1789428024.844650:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857230208 00000100:00100000:2.0:1789428024.844670:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:2.0:1789428024.844680:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876350857230080:12345-192.168.201.55@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789428024.844723:0:15056:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3dd2c17e-239c-4cc3-a060-6d9ba67df7be@192.168.201.55@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:2.0:1789428024.844776:0:15056:0:(genops.c:1384:class_connect()) connect: client 3dd2c17e-239c-4cc3-a060-6d9ba67df7be, cookie 0x2bea1a57ca344711 00002000:00100000:2.0:1789428024.844791:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3dd2c17e-239c-4cc3-a060-6d9ba67df7be/ffff93341dc51000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789428024.844806:0:15056:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789428024.845135:0:15056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789428024.845232:0:15056:0:(import.c:65:import_set_state_nolock()) ffff933406ae8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428024.845336:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2353:x1876350857230080:12345-192.168.201.55@tcp:8:mount.lustre.0 Request processed in 656us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428024.845346:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:1.0:1789428024.845659:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:1.0:1789428024.845667:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876350857230208:12345-192.168.201.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789428024.845695:0:15056:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3dd2c17e-239c-4cc3-a060-6d9ba67df7be@192.168.201.55@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:1.0:1789428024.845940:0:15056:0:(genops.c:1384:class_connect()) connect: client 3dd2c17e-239c-4cc3-a060-6d9ba67df7be, cookie 0x2bea1a57ca344718 00002000:00100000:1.0:1789428024.845952:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3dd2c17e-239c-4cc3-a060-6d9ba67df7be/ffff93341c3f9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789428024.845962:0:15056:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789428024.846074:0:15056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789428024.846099:0:15056:0:(import.c:65:import_set_state_nolock()) ffff933424501800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428024.846154:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2353:x1876350857230208:12345-192.168.201.55@tcp:8:mount.lustre.0 Request processed in 485us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428024.846161:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:0.0:1789428024.849928:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428024.855247:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857230336 00000100:00100000:2.0:1789428024.855270:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857230336 00000100:00100000:2.0:1789428024.855365:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:2.0:1789428024.855378:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:13853:x1876350857230336:12345-192.168.201.55@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789428024.855497:0:14372:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789428024.855662:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:13853:x1876350857230336:12345-192.168.201.55@tcp:33:mount.lustre.0 Request processed in 286us (6213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428024.855670:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:2.0:1789428025.054298:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428025.054468:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857230464 00000100:00100000:0.0:1789428025.054483:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857230464 00000100:00100000:0.0:1789428025.054608:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00100000:0.0:1789428025.054621:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:13885:x1876350857230464:12345-192.168.201.55@tcp:101:mkdir.0 00010000:00010000:0.0:1789428025.054651:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428025.054680:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998c00/0x2bea1a57ca34471f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8b94 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.054784:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.054802:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.054826:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428025.054875:0:14370:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789428025.054879:0:14370:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789428025.054904:0:14370:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.054937:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998c00/0x2bea1a57ca34471f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b94 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.054981:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b94 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428025.054991:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9000) 00010000:00010000:0.0:1789428025.054995:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428025.054999:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301998400, rc 0) 00000100:00100000:0.0:1789428025.055326:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+7:13885:x1876350857230464:12345-192.168.201.55@tcp:101:mkdir.0 Request processed in 705us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.055335:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 14 00010000:00010000:1.0:1789428025.161876:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428025.804659:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877145088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789428025.804766:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428025.804900:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877145088 00000100:00100000:3.0:1789428025.804911:0:15058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877145088 00000100:00100000:3.0:1789428025.804995:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789428025.805006:0:15058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877145088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789428025.805046:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789428025.805102:0:15058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877145088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428025.805111:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789428025.805135:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789428025.805168:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789428025.806765:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877145088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428025.819719:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789428025.819751:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877145472:0@lo:400:kworker.0 00000100:00100000:1.0:1789428025.820138:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428025.820315:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877145472 00000100:00100000:1.0:1789428025.820327:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877145472 00000100:00100000:1.0:1789428025.820418:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789428025.820429:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877145472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428025.820497:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876350877145472:12345-0@lo:400:kworker.0 Request processed in 69us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428025.820505:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789428025.823442:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877145600:0@lo:400:kworker.0 00000100:00100000:0.0:1789428025.823573:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428025.823650:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876350877145472:0@lo:400:kworker.0 00000100:00100000:0.0:1789428025.823711:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877145600 00000100:00100000:0.0:1789428025.823719:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877145600 00000100:00100000:0.0:1789428025.823794:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789428025.823803:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877145600:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789428025.823951:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789428025.824317:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876350877145600:12345-0@lo:400:kworker.0 Request processed in 514us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428025.824326:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789428025.824368:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876350877145600:0@lo:400:kworker.0 00000100:00100000:2.0:1789428025.824919:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877145216:0@lo:400:kworker.0 00000100:00100000:2.0:1789428025.824971:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428025.825014:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877145728:0@lo:400:kworker.0 00000100:00100000:2.0:1789428025.825040:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428025.825064:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789428025.825070:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877145344:0@lo:400:kworker.0 00000100:00100000:2.0:1789428025.825096:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428025.825138:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877145728 00000100:00100000:2.0:1789428025.825144:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877145728 00000100:00100000:2.0:1789428025.825474:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428025.825485:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877145728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428025.825549:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876350877145728:12345-0@lo:400:kworker.0 Request processed in 67us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428025.825556:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428025.825580:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877145216 00000100:00100000:2.0:1789428025.825583:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877145216 00000100:00100000:2.0:1789428025.828006:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789428025.828025:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3298:x1876350877145216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428025.828146:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3298:x1876350877145216:12345-0@lo:400:kworker.0 Request processed in 128us (3174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428025.828156:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789428025.829418:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877145344 00000100:00100000:2.0:1789428025.829432:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877145344 00000100:00100000:2.0:1789428025.829487:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428025.829497:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877145344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428025.829585:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877145344:12345-0@lo:400:kworker.0 Request processed in 89us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428025.829593:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428025.829657:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877145344:0@lo:400:kworker.0 00000100:00100000:2.0:1789428025.829670:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877145216:0@lo:400:kworker.0 00000100:00100000:2.0:1789428025.829684:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876350877145728:0@lo:400:kworker.0 00000100:00080000:2.0:1789428025.829730:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789428025.880704:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10605fa2-3254-437c-8111-34c57e564568 00000001:00100000:1.0:1789428025.880911:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3dd2c17e-239c-4cc3-a060-6d9ba67df7be 00010000:00010000:3.0:1789428026.187237:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789428027.018037:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789428027.209592:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789428027.416997:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3dd2c17e-239c-4cc3-a060-6d9ba67df7be 00000001:00100000:3.0:1789428027.417028:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10605fa2-3254-437c-8111-34c57e564568 00000001:00100000:3.0:1789428027.906786:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3dd2c17e-239c-4cc3-a060-6d9ba67df7be 00000001:02000400:1.0:1789428028.120352:0:16337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789428028.237106:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428029.260233:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428029.385873:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877145856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789428029.385944:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428029.395555:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877145856 00000100:00100000:1.0:1789428029.395573:0:15058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877145856 00000100:00080000:2.0:1789428029.395703:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789428029.396035:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428029.396048:0:15058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877145856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789428029.396087:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789428029.396199:0:15058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877145856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (10254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428029.396207:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428029.396295:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877145856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789428029.915662:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428029.915714:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428029.915766:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428029.915797:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428029.915823:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428029.915855:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857230848 00000100:00100000:0.0:1789428029.915863:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428029.915879:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857230848 00000100:00100000:0.0:1789428029.915902:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428029.915937:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857231104 00000100:00100000:0.0:1789428029.915946:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857231104 00000100:00100000:3.0:1789428029.915984:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857231360 00000100:00100000:3.0:1789428029.915991:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857231360 00000100:00100000:0.0:1789428029.916012:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857230720 00000100:00100000:0.0:1789428029.916019:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857230720 00000100:00100000:3.0:1789428029.916021:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857230976 00000100:00100000:3.0:1789428029.916041:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857230976 00000100:00100000:0.0:1789428029.916057:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:0.0:1789428029.916074:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2354:x1876350857231104:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789428029.916075:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857231232 00000100:00100000:3.0:1789428029.916081:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857231232 00000100:00100000:3.0:1789428029.916127:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:3.0:1789428029.916141:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2354:x1876350857230848:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789428029.916260:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2354:x1876350857230848:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 121us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428029.916268:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:3.0:1789428029.916290:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:3.0:1789428029.916296:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2354:x1876350857231360:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789428029.916342:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2354:x1876350857231360:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 45us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428029.916349:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:3.0:1789428029.916362:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:3.0:1789428029.916368:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2354:x1876350857230976:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789428029.916395:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2354:x1876350857230976:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428029.916401:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:3.0:1789428029.916412:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:3.0:1789428029.916432:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2354:x1876350857231232:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789428029.916498:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2354:x1876350857231232:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 66us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428029.916505:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:2.0:1789428029.916549:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857230592 00000100:00100000:2.0:1789428029.916558:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857230592 00000100:00100000:2.0:1789428029.916605:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 103 00000100:00100000:2.0:1789428029.916613:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+13:2354:x1876350857230592:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789428029.916655:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+13:2354:x1876350857230592:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 43us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428029.916677:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 103 00000100:00100000:2.0:1789428029.916719:0:14369:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789428029.916727:0:14369:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1789428029.916750:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789428029.916756:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789428029.916757:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428029.916766:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789428029.916776:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:2.0:1789428029.916782:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+6:2354:x1876350857230720:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:2.0:1789428029.916812:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+6:2354:x1876350857230720:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 30us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428029.916818:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:0.0:1789428029.917464:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2354:x1876350857231104:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 104us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428029.917474:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 19 00010000:00010000:3.0:1789428030.281497:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428030.923452:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789428030.923474:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877145984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428030.923540:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428030.923619:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877145984 00000100:00100000:1.0:1789428030.923635:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877145984 00000100:00100000:1.0:1789428030.923687:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428030.923696:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877145984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789428030.923728:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789428030.923770:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876350877145984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428030.923778:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428030.923824:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876350877145984:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789428030.924334:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789428030.932964:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877146496:0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428030.933075:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789428030.933082:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:92161c2e-b691-4539-8b6b-a6d322602ab0:3300:1876350877146112:0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933111:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428030.933135:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877146624:0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933155:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428030.933214:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877146240:0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933242:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428030.933265:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789428030.933271:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93330387f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877146368:0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933294:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428030.933341:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877146496 00000100:00100000:2.0:1789428030.933350:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877146496 00000100:00100000:2.0:1789428030.933397:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877146624 00000100:00100000:2.0:1789428030.933401:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877146624 00000100:00100000:2.0:1789428030.933413:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877146368 00000100:00100000:2.0:1789428030.933416:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877146368 00000100:00100000:2.0:1789428030.933443:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789428030.933452:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877146496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933501:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876350877146496:12345-0@lo:400:kworker.0 Request processed in 50us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428030.933508:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789428030.933525:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789428030.933531:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877146624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933558:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876350877146624:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428030.933564:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789428030.933575:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789428030.933581:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877146368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933623:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876350877146368:12345-0@lo:400:kworker.0 Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428030.933628:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789428030.933647:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877146112 00000100:00100000:2.0:1789428030.933651:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877146112 00000100:00100000:2.0:1789428030.933673:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789428030.933680:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3300:x1876350877146112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933709:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3300:x1876350877146112:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428030.933724:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1789428030.933751:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789428030.933779:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:92161c2e-b691-4539-8b6b-a6d322602ab0:3300:1876350877146112:0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933792:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876350877146624:0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933801:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876350877146496:0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933831:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93330387f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876350877146368:0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933865:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877146240 00000100:00100000:2.0:1789428030.933868:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877146240 00000100:00100000:2.0:1789428030.933895:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428030.933901:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877146240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428030.933937:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877146240:12345-0@lo:400:kworker.0 Request processed in 36us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428030.933943:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428030.933969:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877146240:0@lo:400:kworker.0 00010000:00010000:0.0:1789428031.306356:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789428031.607788:0:16486:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4ac55050 20000000:00000080:0.0:1789428031.607806:0:16486:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff933302ad5400 uarg=0000000000000000 20000000:01000000:0.0:1789428031.607838:0:16486:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789428031.607844:0:16486:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789428031.607848:0:16486:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789428031.608903:0:16487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789428031.609155:0:16486:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789428031.619839:0:16486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789428031.619875:0:16486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.619894:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34441d expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.619902:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34446a expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.619937:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca34459e expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.619946:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b08 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.619953:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b6a expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.619961:0:16486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.620011:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b6a expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.620027:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b6a expref: 12 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.620043:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877146752:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789428031.620299:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b08 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.620310:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b08 expref: 12 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.620318:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877146880:192.168.201.55@tcp:104: 00010000:00010000:0.0:1789428031.620354:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34459e expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.620374:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34459e expref: 18 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.620383:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877147008:0@lo:104: 00000100:00100000:0.0:1789428031.620445:0:16486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789428031.620490:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34446a expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.620497:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34446a expref: 18 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.620506:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877147136:0@lo:104: 00000100:00100000:0.0:1789428031.620528:0:16486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789428031.620548:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bea1a57ca34441d expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.620556:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bea1a57ca34441d expref: 18 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.620563:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877147264:0@lo:104: 00000100:00100000:0.0:1789428031.620601:0:16486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428031.620612:0:16486:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428031.621226:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789428031.621240:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877147008 00000100:00100000:2.0:1789428031.621246:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877147008 00000100:00100000:2.0:1789428031.621280:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877147136 00000100:00100000:2.0:1789428031.621283:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877147136 00000100:00100000:2.0:1789428031.621294:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877147264 00000100:00100000:2.0:1789428031.621296:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877147264 00000100:00100000:2.0:1789428031.621307:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428031.621314:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+5:16486:x1876350877147008:12345-0@lo:104: 00010000:00010000:2.0:1789428031.621328:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.621593:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789428031.621600:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+5:16486:x1876350877147008:12345-0@lo:104: Request processed in 286us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428031.621608:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428031.621749:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428031.621756:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+4:16486:x1876350877147136:12345-0@lo:104: 00010000:00010000:2.0:1789428031.621765:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.621803:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789428031.621808:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+4:16486:x1876350877147136:12345-0@lo:104: Request processed in 53us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428031.621814:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428031.621827:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428031.621833:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343c220850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+3:16486:x1876350877147264:12345-0@lo:104: 00010000:00010000:2.0:1789428031.621840:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.621866:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789428031.621871:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343c220850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+3:16486:x1876350877147264:12345-0@lo:104: Request processed in 39us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428031.621877:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789428031.621983:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789428031.621990:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622008:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d4400 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789428031.622012:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622019:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428031.622026:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428031.622032:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789428031.622068:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622074:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428031.622094:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622100:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff93340e1d4400/0x2bea1a57ca34459e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca3445a5 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622114:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428031.622117:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622123:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031800 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789428031.622125:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622143:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428031.622149:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428031.622154:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789428031.622167:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622194:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428031.622202:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622209:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400031800/0x2bea1a57ca34446a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca344471 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622220:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428031.622223:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622228:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933400031000 already unused, calling callback (ffffffffc1e08c20) 10000000:00010000:2.0:1789428031.622231:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622239:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428031.622245:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428031.622256:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789428031.622270:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622275:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428031.622292:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622298:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.155@tcp lock: ffff933400031000/0x2bea1a57ca34441d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bea1a57ca344424 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.622312:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428031.622314:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428031.622315:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428031.622328:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877147392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428031.622359:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428031.622384:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789428031.625312:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877147520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428031.626108:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877147008:0@lo:104: 00000100:00100000:0.0:1789428031.626121:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877147136:0@lo:104: 00000100:00100000:0.0:1789428031.626129:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877147264:0@lo:104: 00000100:00100000:2.0:1789428031.626196:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428031.626265:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:92161c2e-b691-4539-8b6b-a6d322602ab0:3300:1876350877147648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428031.626302:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428031.626347:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877147392 00000100:00100000:2.0:1789428031.626354:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877147392 00010000:00010000:3.0:1789428031.626575:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428031.627296:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877147520 00000100:00100000:0.0:1789428031.627305:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877147520 00010000:00010000:0.0:1789428031.627342:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34446a expref: 20 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.627379:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877147648 00000100:00100000:0.0:1789428031.627382:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877147648 00010000:00010000:2.0:1789428031.627569:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34459e expref: 21 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428031.627605:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428031.627803:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+21:3298:x1876350877147520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428031.627825:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428031.627831:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34446a expref: 21 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.627844:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34446a expref: 21 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.627863:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34446a expref: 21 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.627878:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428031.627957:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+20:3298:x1876350877147520:12345-0@lo:103:ldlm_bl.0 Request processed in 343us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428031.627964:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428031.627984:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428031.627991:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3298:x1876350877147392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428031.627999:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428031.628004:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34459e expref: 19 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.628012:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34459e expref: 19 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.628023:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933420700200/0x2bea1a57ca3445a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34459e expref: 19 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.628032:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428031.628055:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:3298:x1876350877147392:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (5695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428031.628072:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428031.628117:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877147520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428031.628127:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:92161c2e-b691-4539-8b6b-a6d322602ab0:3298:1876350877147392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789428031.628279:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34441d expref: 17 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428031.628308:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428031.628315:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334335a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92161c2e-b691-4539-8b6b-a6d322602ab0+17:3300:x1876350877147648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789428031.628323:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428031.628327:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bea1a57ca34441d expref: 17 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.628335:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bea1a57ca34441d expref: 17 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.628345:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93341e179400/0x2bea1a57ca344424 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bea1a57ca34441d expref: 17 pid: 14363 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428031.628353:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428031.628386:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334335a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:3300:x1876350877147648:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428031.628406:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428031.628805:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:92161c2e-b691-4539-8b6b-a6d322602ab0:3300:1876350877147648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428031.641291:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877146752:192.168.201.55@tcp:104: 00000100:00100000:2.0:1789428031.641312:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1876350877146880:192.168.201.55@tcp:104: 00010000:00010000:2.0:1789428031.641352:0:16486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428031.655624:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428031.655899:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428031.657821:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857231488 00000100:00100000:0.0:1789428031.657835:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857231488 00010000:00010000:2.0:1789428031.657957:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b6a expref: 13 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428031.657993:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857231616 00000100:00100000:2.0:1789428031.657997:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857231616 00010000:00010000:2.0:1789428031.658008:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b08 expref: 14 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428031.658021:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:2.0:1789428031.658028:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:335f5f6b-62a5-411c-9395-a123e708efa6+14:2356:x1876350857231488:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428031.658043:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428031.658047:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b6a expref: 14 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658077:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b6a expref: 14 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658093:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933301999600/0x2bea1a57ca344703 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b6a expref: 14 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658109:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428031.658210:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:335f5f6b-62a5-411c-9395-a123e708efa6+13:2356:x1876350857231488:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 179us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428031.658218:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:2.0:1789428031.658239:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:2.0:1789428031.658246:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:335f5f6b-62a5-411c-9395-a123e708efa6+12:2356:x1876350857231616:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428031.658254:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428031.658258:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b08 expref: 12 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658266:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b08 expref: 12 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658276:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933400030e00/0x2bea1a57ca3446cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b08 expref: 12 pid: 14361 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658286:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658294:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658321:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658328:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658335:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658342:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658349:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998200 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428031.658353:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658362:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.658376:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.659027:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428031.659068:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:335f5f6b-62a5-411c-9395-a123e708efa6+11:2356:x1876350857231616:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 821us (3168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428031.659075:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00010000:00010000:2.0:1789428031.659117:0:16486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.659126:0:16486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428031.659139:0:16486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933301998200/0x2bea1a57ca34472d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428032.329482:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789428032.969735:0:14365:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789428032.969743:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93341c3ff000 from 10 10000000:01000000:0.0:1789428032.969748:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428032.969794:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933301999800/0x2bea1a57ca344734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428032.969824:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933301999800/0x2bea1a57ca344734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428032.969837:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933301999800/0x2bea1a57ca344734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428032.969862:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877147776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428032.969928:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428032.969982:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428032.970224:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877147776 00000100:00100000:3.0:1789428032.970234:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877147776 00000100:00100000:3.0:1789428032.970299:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789428032.970309:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+16:14365:x1876350877147776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428032.970324:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428032.970339:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9334421c7200/0x2bea1a57ca34473b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344734 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428032.970364:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9334421c7200/0x2bea1a57ca34473b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344734 expref: 17 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428032.970374:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9334421c7200/0x2bea1a57ca34473b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344734 expref: 17 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428032.970401:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7200, rc 0) 00000100:00100000:3.0:1789428032.970452:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+17:14365:x1876350877147776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428032.970459:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789428032.971263:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877147776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428032.971278:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933301999800/0x2bea1a57ca344734 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34473b expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428032.971286:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933301999800/0x2bea1a57ca344734 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca34473b expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428032.971339:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877147904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428032.971377:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428032.971417:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428032.971490:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877147904 00000100:00100000:3.0:1789428032.971497:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877147904 00000100:00100000:3.0:1789428032.973532:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789428032.973551:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+17:14365:x1876350877147904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428032.973864:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+17:14365:x1876350877147904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (2485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428032.973873:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789428032.974149:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877147904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789428032.974223:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341e217800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428032.974269:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428032.986316:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877148032 00000100:00100000:0.0:1789428032.986334:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877148032 00000100:00100000:0.0:1789428032.986487:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789428032.986498:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+17:14365:x1876350877148032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428032.986874:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+17:14365:x1876350877148032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 377us (12603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428032.986882:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789428032.994721:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341062f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789428032.996532:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341e217800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789428033.007660:0:16542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789428033.007744:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789428033.007767:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789428033.007778:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933301999800/0x2bea1a57ca344734 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34473b expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.007790:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933301999800/0x2bea1a57ca344734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca34473b expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428033.007801:0:14365:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789428033.007804:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933406aea800 from 10 10000000:01000000:0.0:1789428033.007806:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428033.007845:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933301999a00/0x2bea1a57ca344742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.007854:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933301999a00/0x2bea1a57ca344742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.007866:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933301999a00/0x2bea1a57ca344742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428033.007891:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.007960:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428033.008004:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbe9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428033.008456:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877148160 00000100:00100000:2.0:1789428033.008464:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877148160 00000100:00100000:2.0:1789428033.008512:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789428033.008520:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+17:14365:x1876350877148160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428033.008534:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428033.008546:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93340e1d4400/0x2bea1a57ca344749 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344742 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.008570:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93340e1d4400/0x2bea1a57ca344749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344742 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.008581:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93340e1d4400/0x2bea1a57ca344749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344742 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.008589:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4400, rc 0) 00000100:00100000:2.0:1789428033.008633:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+18:14365:x1876350877148160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428033.008640:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789428033.008687:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428033.008701:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933301999a00/0x2bea1a57ca344742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344749 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.008719:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933301999a00/0x2bea1a57ca344742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca344749 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428033.008769:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428033.008793:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428033.008820:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334336bd780 going to sleep for 11 seconds 00000100:00100000:0.0:1789428033.009216:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877148288 00000100:00100000:0.0:1789428033.009221:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877148288 00000100:00100000:0.0:1789428033.009245:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789428033.009251:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+18:14365:x1876350877148288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.009503:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+18:14365:x1876350877148288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428033.009520:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789428033.015254:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428033.015320:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789428033.015550:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428033.015588:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9334336bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1789428033.017242:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877148416 00000100:00100000:1.0:1789428033.017256:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877148416 00000100:00100000:1.0:1789428033.017310:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789428033.017319:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:14365:x1876350877148416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428033.017558:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+18:14365:x1876350877148416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428033.017567:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789428033.017734:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789428033.026312:0:16545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789428033.031773:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789428033.031813:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789428033.031828:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933301999a00/0x2bea1a57ca344742 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344749 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.031844:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933301999a00/0x2bea1a57ca344742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344749 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428033.031854:0:14365:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789428033.031857:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333031bc000 from 10 10000000:01000000:0.0:1789428033.031860:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428033.031905:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.155@tcp lock: ffff933301999200/0x2bea1a57ca344750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.031914:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.155@tcp lock: ffff933301999200/0x2bea1a57ca344750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.031927:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.155@tcp lock: ffff933301999200/0x2bea1a57ca344750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428033.031959:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.032035:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428033.032110:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428033.032540:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877148544 00000100:00100000:2.0:1789428033.032550:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877148544 00000100:00100000:2.0:1789428033.032610:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789428033.032621:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+18:14365:x1876350877148544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428033.032635:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428033.032648:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bea1a57ca344750 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.032677:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bea1a57ca344750 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.032688:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93340e1d5c00/0x2bea1a57ca344757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bea1a57ca344750 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.032710:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5c00, rc 0) 00000100:00100000:2.0:1789428033.032764:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92161c2e-b691-4539-8b6b-a6d322602ab0+19:14365:x1876350877148544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428033.032770:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789428033.032837:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428033.032854:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.155@tcp lock: ffff933301999200/0x2bea1a57ca344750 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344757 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428033.032863:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.155@tcp lock: ffff933301999200/0x2bea1a57ca344750 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bea1a57ca344757 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428033.032937:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.032968:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428033.033003:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428033.033480:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877148672 00000100:00100000:2.0:1789428033.033486:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877148672 00000100:00100000:2.0:1789428033.033525:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789428033.033533:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b9d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:14365:x1876350877148672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428033.033829:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b9d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92161c2e-b691-4539-8b6b-a6d322602ab0+19:14365:x1876350877148672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428033.033837:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789428033.033958:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.034000:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428033.034039:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428033.034067:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff933420fbea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789428033.036688:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877148800 00000100:00100000:3.0:1789428033.036702:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877148800 00000100:00100000:3.0:1789428033.036775:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789428033.036785:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:14365:x1876350877148800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.037031:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:14365:x1876350877148800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428033.037039:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789428033.037104:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:92161c2e-b691-4539-8b6b-a6d322602ab0:14365:1876350877148800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789428033.039236:0:16546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789428033.039288:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789428033.039308:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789428033.039318:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.155@tcp lock: ffff933301999200/0x2bea1a57ca344750 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344757 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428033.039330:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.155@tcp lock: ffff933301999200/0x2bea1a57ca344750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bea1a57ca344757 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428033.354245:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428033.560906:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428033.566998:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857231744 00000100:00100000:1.0:1789428033.567017:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857231744 00000100:00100000:1.0:1789428033.568878:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 114 00000100:00100000:1.0:1789428033.568902:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+11:13740:x1876350857231744:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428033.568929:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428033.568955:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933420700000/0x2bea1a57ca34475e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8b9b expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428033.568996:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933420700000/0x2bea1a57ca34475e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b9b expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428033.569009:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933420700000/0x2bea1a57ca34475e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b9b expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428033.569020:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700000, rc 0) 00000100:00100000:1.0:1789428033.569112:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+12:13740:x1876350857231744:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 Request processed in 218us (8222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428033.569120:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 114 00000100:00100000:0.0:1789428033.577267:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428033.577410:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857231872 00000100:00100000:3.0:1789428033.577423:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857231872 00000100:00100000:3.0:1789428033.577494:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 115 00000100:00100000:3.0:1789428033.577506:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+12:13740:x1876350857231872:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.577992:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+12:13740:x1876350857231872:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 Request processed in 484us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428033.578002:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 115 00000100:00100000:0.0:1789428033.590966:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428033.591069:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857232000 00000100:00100000:1.0:1789428033.591086:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857232000 00000100:00100000:1.0:1789428033.591169:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 116 00000100:00100000:1.0:1789428033.591220:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+12:13740:x1876350857232000:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428033.591546:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+12:13740:x1876350857232000:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 Request processed in 327us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428033.591555:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 116 00000100:00100000:1.0:1789428033.599999:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428033.600098:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857232128 00000100:00100000:2.0:1789428033.600113:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857232128 00000100:00100000:2.0:1789428033.600216:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 117 00000100:00100000:2.0:1789428033.600229:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+12:13740:x1876350857232128:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428033.600262:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428033.600288:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93340e1d4e00/0x2bea1a57ca344765 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x954cd080504a8ba2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.600326:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93340e1d4e00/0x2bea1a57ca344765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ba2 expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.600339:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93340e1d4e00/0x2bea1a57ca344765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ba2 expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428033.600349:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4e00, rc 0) 00000100:00100000:2.0:1789428033.600450:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+13:13740:x1876350857232128:12345-192.168.201.55@tcp:101:ll_cfg_requeue.0 Request processed in 222us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428033.600458:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 117 00000100:00100000:0.0:1789428033.612860:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428033.613026:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857232256 00000100:00100000:3.0:1789428033.613041:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857232256 00000100:00100000:3.0:1789428033.613117:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 118 00000100:00100000:3.0:1789428033.613130:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+13:13740:x1876350857232256:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428033.613925:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:335f5f6b-62a5-411c-9395-a123e708efa6+13:13740:x1876350857232256:12345-192.168.201.55@tcp:501:ll_cfg_requeue.0 Request processed in 792us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428033.613937:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 118 00000100:00100000:0.0:1789428033.618290:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428033.618607:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857232384 00000100:00100000:1.0:1789428033.618621:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857232384 00000100:00100000:1.0:1789428033.618700:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 119 00000100:00100000:1.0:1789428033.618712:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+13:13740:x1876350857232384:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428033.619013:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+13:13740:x1876350857232384:12345-192.168.201.55@tcp:503:ll_cfg_requeue.0 Request processed in 301us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428033.619022:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 119 00010000:00010000:2.0:1789428034.377464:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428034.505561:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789428034.505598:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877148928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789428034.505707:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428034.505913:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877148928 00000100:00100000:2.0:1789428034.505924:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877148928 00000100:00100000:2.0:1789428034.506009:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789428034.506021:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877148928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428034.506071:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789428034.506128:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877148928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428034.506136:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789428034.506507:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428034.506624:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877148928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428035.039316:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.039404:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.039443:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.039481:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.039510:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.039531:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.039556:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.039591:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857232768 00000100:00100000:1.0:1789428035.039605:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857232768 00000100:00100000:1.0:1789428035.039676:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857233280 00000100:00100000:1.0:1789428035.039680:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857233280 00000100:00100000:1.0:1789428035.039697:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857232896 00000100:00100000:1.0:1789428035.039700:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857232896 00000100:00100000:1.0:1789428035.039713:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857233152 00000100:00100000:1.0:1789428035.039716:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857233152 00000100:00100000:1.0:1789428035.039761:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:1.0:1789428035.039772:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2355:x1876350857232768:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789428035.039872:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2355:x1876350857232768:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 101us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428035.039880:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:1.0:1789428035.039901:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:1.0:1789428035.039907:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2355:x1876350857233280:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789428035.039933:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2355:x1876350857233280:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428035.039939:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:1.0:1789428035.039951:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:1.0:1789428035.039958:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2355:x1876350857232896:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789428035.039980:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2355:x1876350857232896:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 23us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428035.039985:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:1.0:1789428035.039996:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:1.0:1789428035.040001:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2355:x1876350857233152:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789428035.040023:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2355:x1876350857233152:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 22us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428035.040028:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:1.0:1789428035.040049:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857233024 00000100:00100000:1.0:1789428035.040053:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857233024 00000100:00100000:1.0:1789428035.040082:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857232640 00000100:00100000:1.0:1789428035.040085:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857232640 00000100:00100000:1.0:1789428035.040115:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:1.0:1789428035.040121:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2355:x1876350857233024:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789428035.040150:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2355:x1876350857233024:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 29us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428035.040156:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:1.0:1789428035.040167:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00100000:1.0:1789428035.040229:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+6:2355:x1876350857232640:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789428035.040255:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+6:2355:x1876350857232640:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 81us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428035.040262:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00080000:1.0:1789428035.040447:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789428035.040454:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789428035.040456:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428035.040889:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857232512 00000100:00100000:0.0:1789428035.040897:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857232512 00000100:00100000:0.0:1789428035.040955:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 120 00000100:00100000:0.0:1789428035.040963:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+13:2355:x1876350857232512:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789428035.041017:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:335f5f6b-62a5-411c-9395-a123e708efa6+13:2355:x1876350857232512:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 55us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428035.041025:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 120 00000100:00100000:3.0:1789428035.359804:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.359973:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857233408 00000100:00100000:2.0:1789428035.359987:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857233408 00000100:00100000:2.0:1789428035.360071:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:2.0:1789428035.360083:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+6:14395:x1876350857233408:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428035.360109:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428035.360142:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca34476c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8ba9 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360258:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360275:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360291:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360328:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360335:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360342:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360740:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4200/0x2bea1a57ca344781 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360750:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4200/0x2bea1a57ca344781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360758:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4200/0x2bea1a57ca344781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428035.360788:0:14369:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789428035.360791:0:14369:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789428035.360836:0:14369:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4200/0x2bea1a57ca344781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.360995:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361002:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361009:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361026:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d4000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428035.361032:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361040:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361054:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9000) 00010000:00010000:2.0:1789428035.361057:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428035.361064:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361071:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca344773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361085:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361091:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361097:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361103:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d4800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428035.361106:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361113:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361133:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9334220b8f00) 00010000:00010000:2.0:1789428035.361135:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428035.361138:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361144:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34477a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361252:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca34476c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ba9 expref: 8 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361268:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4200/0x2bea1a57ca344781 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8ba9 expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.361275:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9334220b8400) 00010000:00010000:2.0:1789428035.361277:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428035.361280:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4200, rc 0) 00000100:00100000:2.0:1789428035.361381:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+7:14395:x1876350857233408:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 1299us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.361390:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:2.0:1789428035.369744:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.369983:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857233664 00000100:00100000:1.0:1789428035.369996:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857233664 00000100:00100000:1.0:1789428035.370073:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:1.0:1789428035.370086:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+7:14395:x1876350857233664:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789428035.370113:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428035.370144:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca344788 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bb0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.370269:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.370288:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.370303:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.370339:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.370357:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.370365:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371052:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34479d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371066:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34479d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371075:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34479d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789428035.371087:0:14368:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789428035.371384:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371393:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371401:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371408:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428035.371414:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371434:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371450:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9334220b8400) 00010000:00010000:1.0:1789428035.371453:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428035.371459:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371466:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34478f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371479:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371485:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371490:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371495:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428035.371498:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371504:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371510:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9334155e4a00) 00010000:00010000:1.0:1789428035.371512:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428035.371515:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.371545:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701e00/0x2bea1a57ca344796 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.375170:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701600/0x2bea1a57ca344788 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bb0 expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.375224:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701400/0x2bea1a57ca34479d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bb0 expref: 9 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.375234:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9334155e4300) 00010000:00010000:1.0:1789428035.375237:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428035.375242:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701400, rc 0) 00000100:00100000:1.0:1789428035.375379:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+9:14395:x1876350857233664:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 5294us (5651us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789428035.375392:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:1.0:1789428035.381284:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.381602:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857233792 00000100:00100000:2.0:1789428035.381616:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857233792 00000100:00100000:2.0:1789428035.381694:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:2.0:1789428035.381706:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+9:14395:x1876350857233792:12345-192.168.201.55@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789428035.381860:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+9:14395:x1876350857233792:12345-192.168.201.55@tcp:59:lhsmtool_posix.0 Request processed in 156us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.381887:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 17 00010000:00010000:3.0:1789428035.401657:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428035.466338:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.466960:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857233920 00000100:00100000:2.0:1789428035.466976:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857233920 00000100:00100000:2.0:1789428035.467060:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 18 00000100:00100000:2.0:1789428035.467073:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+9:14401:x1876350857233920:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789428035.467102:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428035.467129:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bb7 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.467254:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.467276:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.467292:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.467314:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.467321:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.467329:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.468989:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469028:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469039:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469046:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d4800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428035.469053:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469062:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469084:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9000) 00010000:00010000:2.0:1789428035.469088:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428035.469094:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469101:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469118:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469124:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469130:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469135:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d4000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428035.469145:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469152:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469160:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9334220b8f00) 00010000:00010000:2.0:1789428035.469163:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428035.469167:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.469938:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.470022:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bb7 expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.470034:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9000) 00010000:00010000:2.0:1789428035.470036:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428035.470039:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bb7 expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.470050:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5800, rc 0) 00000100:00100000:2.0:1789428035.470157:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+9:14401:x1876350857233920:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 3084us (3830us total) trans 0 rc 301/301 00000100:00100000:2.0:1789428035.470167:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 18 00000100:00100000:1.0:1789428035.480590:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.480823:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857234048 00000100:00100000:2.0:1789428035.482825:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857234048 00000100:00100000:2.0:1789428035.483147:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:2.0:1789428035.483161:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10605fa2-3254-437c-8111-34c57e564568+9:14401:x1876350857234048:12345-192.168.201.55@tcp:700:lfs.0 00000100:00100000:2.0:1789428035.485016:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10605fa2-3254-437c-8111-34c57e564568+9:14401:x1876350857234048:12345-192.168.201.55@tcp:700:lfs.0 Request processed in 1846us (4560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.485032:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:1.0:1789428035.492777:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.492952:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857234304 00000100:00100000:2.0:1789428035.492967:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857234304 00000100:00100000:2.0:1789428035.493055:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 19 00000100:00100000:2.0:1789428035.493068:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+9:14401:x1876350857234304:12345-192.168.201.55@tcp:36:lfs.0 00010000:00010000:2.0:1789428035.493148:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428035.493236:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3446ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b32 expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.493261:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9000) 00010000:00010000:2.0:1789428035.493267:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789428035.493611:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.493628:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b94 expref: 5 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.493638:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.493685:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b94 expref: 5 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.493705:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b94 expref: 5 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428035.493737:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14369:1876350877149056:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789428035.495714:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410cfdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428035.497541:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.498354:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14369:1876350877149056:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789428035.498395:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428035.503058:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857234432 00000100:00100000:2.0:1789428035.503081:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857234432 00010000:00010000:2.0:1789428035.503218:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b94 expref: 6 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428035.503274:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:2.0:1789428035.503286:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2357:x1876350857234432:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428035.503304:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428035.503311:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b94 expref: 6 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.503326:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b94 expref: 6 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.503363:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344726 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8b94 expref: 6 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.503381:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9000) 00010000:00010000:2.0:1789428035.503388:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.503398:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.503408:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.503464:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428035.503545:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2357:x1876350857234432:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 261us (6028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.503553:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 9 00010000:00010000:1.0:1789428035.503976:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.503987:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.504028:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.504040:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.504048:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789428035.508826:0:14369:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789428035.509010:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.509025:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.509035:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.509042:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d5800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428035.509048:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.509057:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.509076:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9000) 00010000:00010000:1.0:1789428035.509079:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428035.509086:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.509167:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789428035.509380:0:14369:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b38c20cb reply state 0000000006225b00 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428035.509391:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789428035.509656:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+10:14401:x1876350857234304:12345-192.168.201.55@tcp:36:lfs.0 Request processed in 16584us (16887us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789428035.509667:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 19 00010000:00010000:1.0:1789428035.512362:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.512387:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.512397:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.512404:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428035.512409:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.512418:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.512437:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9334155e4a00) 00010000:00010000:1.0:1789428035.512441:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428035.512448:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428035.512476:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca3447c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428035.580037:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428035.580986:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857234560 00000100:00100000:0.0:1789428035.581004:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857234560 00000100:00100000:0.0:1789428035.581171:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:0.0:1789428035.581208:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+9:14409:x1876350857234560:12345-192.168.201.55@tcp:101:lctl.0 00010000:00010000:0.0:1789428035.581248:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428035.581283:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca3447ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bbe expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.581386:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3447d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.581404:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3447d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.581421:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3447d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428035.581468:0:14368:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789428035.581472:0:14368:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789428035.581523:0:14368:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3447d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.581555:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca3447ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bbe expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.581580:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998a00/0x2bea1a57ca3447d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bbe expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.581589:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9700) 00010000:00010000:0.0:1789428035.581592:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428035.581615:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301998a00, rc 0) 00000100:00100000:0.0:1789428035.581763:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+10:14409:x1876350857234560:12345-192.168.201.55@tcp:101:lctl.0 Request processed in 560us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428035.581772:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 20 00000100:00100000:3.0:1789428035.646654:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.647149:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857234688 00000100:00100000:1.0:1789428035.647167:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857234688 00000100:00100000:2.0:1789428035.650639:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00100000:2.0:1789428035.650658:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:14410:x1876350857234688:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789428035.650687:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428035.650717:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bc5 expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.650806:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4a00/0x2bea1a57ca3447e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.650826:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4a00/0x2bea1a57ca3447e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.650843:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4a00/0x2bea1a57ca3447e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428035.650892:0:16404:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789428035.650897:0:16404:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789428035.650939:0:16404:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4a00/0x2bea1a57ca3447e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.650970:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3447dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bc5 expref: 7 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.650994:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4a00/0x2bea1a57ca3447e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bc5 expref: 6 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.651022:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9700) 00010000:00010000:2.0:1789428035.651025:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428035.651031:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4a00, rc 0) 00000100:00100000:2.0:1789428035.651143:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:14410:x1876350857234688:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 488us (4499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.651151:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 21 00000100:00100000:1.0:1789428035.657935:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.658531:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857234816 00000100:00100000:2.0:1789428035.658545:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857234816 00000100:00100000:2.0:1789428035.658660:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:2.0:1789428035.658672:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341e214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:14410:x1876350857234816:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789428035.658701:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428035.658730:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3447ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bcc expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.658824:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.658852:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.658867:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.658888:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.658895:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.658935:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659267:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659295:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659308:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428035.659416:0:14370:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789428035.659421:0:14370:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789428035.659442:0:14370:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659456:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659463:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659470:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659477:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d5000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428035.659481:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659741:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659772:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9700) 00010000:00010000:2.0:1789428035.659775:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428035.659780:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659786:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3447f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659803:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659810:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659816:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659821:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d5800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428035.659827:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659833:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659841:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9334220b8f00) 00010000:00010000:2.0:1789428035.659843:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428035.659847:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659853:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3447f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659909:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca3447ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bcc expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659924:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bcc expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.659931:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9334220b8000) 00010000:00010000:2.0:1789428035.659933:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428035.659936:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4000, rc 0) 00000100:00100000:2.0:1789428035.660026:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341e214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+7:14410:x1876350857234816:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 1355us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.660035:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 22 00000100:00100000:3.0:1789428035.677591:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428035.678036:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857235072 00000100:00100000:1.0:1789428035.678054:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857235072 00000100:00100000:0.0:1789428035.679136:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 23 00000100:00100000:0.0:1789428035.679165:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+7:14410:x1876350857235072:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:0.0:1789428035.679535:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428035.679569:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bd3 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428035.679702:0:14369:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789428035.680485:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344806 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bd3 expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.680507:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9700) 00010000:00010000:0.0:1789428035.680511:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789428035.680518:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bd3 expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.680539:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301998400, rc 0) 00000100:00100000:0.0:1789428035.680653:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+8:14410:x1876350857235072:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 1501us (3077us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789428035.680663:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 23 00000100:00100000:3.0:1789428035.685896:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428035.686072:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857235328 00000100:00100000:0.0:1789428035.686097:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857235328 00000100:00100000:0.0:1789428035.686226:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 24 00000100:00100000:0.0:1789428035.686240:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+8:14410:x1876350857235328:12345-192.168.201.55@tcp:36:lfs.0 00010000:00010000:0.0:1789428035.686456:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428035.686496:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca3447ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bcc expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.686520:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9334220b8000) 00010000:00010000:0.0:1789428035.686535:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789428035.686569:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.686585:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.686598:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789428035.687493:0:14368:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000050c97c05 reply state 00000000fdd9e999 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428035.687509:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789428035.687523:0:14368:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789428035.687651:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+9:14410:x1876350857235328:12345-192.168.201.55@tcp:36:lfs.0 Request processed in 1412us (1768us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789428035.687660:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 24 00010000:00010000:2.0:1789428035.690616:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.690643:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.690653:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.690661:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428035.690667:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.690675:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.690696:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:2.0:1789428035.690707:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789428035.690714:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.690721:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998400/0x2bea1a57ca344814 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428035.691493:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.698019:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857235584 00000100:00100000:2.0:1789428035.698046:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857235584 00000100:00100000:2.0:1789428035.698423:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:2.0:1789428035.698438:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+8:14410:x1876350857235584:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789428035.698803:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+9:14410:x1876350857235584:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 368us (7318us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789428035.698813:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:1.0:1789428035.716330:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.716991:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857235840 00000100:00100000:2.0:1789428035.717008:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857235840 00000100:00100000:2.0:1789428035.717241:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00100000:2.0:1789428035.717254:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+9:14410:x1876350857235840:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789428035.717290:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428035.717318:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34481b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bda expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717429:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717448:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717463:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717503:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717510:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717527:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428035.717677:0:16404:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789428035.717800:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717810:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717818:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717825:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d5800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428035.717830:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717851:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717865:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9700) 00010000:00010000:2.0:1789428035.717868:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428035.717875:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717892:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717909:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717924:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717931:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717936:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d5000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428035.717940:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717947:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717955:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9334220b8f00) 00010000:00010000:2.0:1789428035.717958:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428035.717961:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.717967:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.718013:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34481b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bda expref: 11 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.718035:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9700) 00010000:00010000:2.0:1789428035.718037:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789428035.718041:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34481b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bda expref: 11 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.718051:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4600, rc 0) 00000100:00100000:2.0:1789428035.718157:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+10:14410:x1876350857235840:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 905us (2079us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789428035.718166:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 25 00000100:00100000:1.0:1789428035.725492:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.725666:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857235968 00000100:00100000:2.0:1789428035.725682:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857235968 00000100:00100000:2.0:1789428035.725766:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 26 00000100:00100000:2.0:1789428035.725779:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+10:14410:x1876350857235968:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789428035.725815:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428035.725846:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca344837 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8be1 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.725974:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.725991:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.726006:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428035.726037:0:14370:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789428035.726060:0:14370:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789428035.726216:0:14370:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.726251:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca344837 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be1 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.726273:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be1 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.726282:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9334220b8300) 00010000:00010000:2.0:1789428035.726284:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428035.726289:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4000, rc 0) 00000100:00100000:2.0:1789428035.726547:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+11:14410:x1876350857235968:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 769us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.726556:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 26 00000100:00100000:3.0:1789428035.742045:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.745758:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857236096 00000100:00100000:2.0:1789428035.745784:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857236096 00000100:00100000:2.0:1789428035.745880:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:2.0:1789428035.745894:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+11:14410:x1876350857236096:12345-192.168.201.55@tcp:37:lfs.0 00000100:00100000:2.0:1789428035.754104:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+11:14410:x1876350857236096:12345-192.168.201.55@tcp:37:lfs.0 Request processed in 8195us (12056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.754122:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:1.0:1789428035.767319:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428035.767445:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857236352 00000100:00100000:3.0:1789428035.767461:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857236352 00000100:00100000:3.0:1789428035.767538:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:3.0:1789428035.767551:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406aaa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+11:14410:x1876350857236352:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:3.0:1789428035.767910:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406aaa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+12:14410:x1876350857236352:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 359us (607us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789428035.767918:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:3.0:1789428035.846281:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428035.846456:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857236480 00000100:00100000:0.0:1789428035.846468:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857236480 00000100:00100000:0.0:1789428035.846543:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 27 00000100:00100000:0.0:1789428035.846555:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+10:14416:x1876350857236480:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:0.0:1789428035.846578:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428035.846598:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998c00/0x2bea1a57ca344845 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8be8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.846687:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.846704:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.846716:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.846733:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.846740:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.846747:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.846982:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998200/0x2bea1a57ca34485a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.846992:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301998200/0x2bea1a57ca34485a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847000:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998200/0x2bea1a57ca34485a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428035.847030:0:14369:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789428035.847034:0:14369:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789428035.847074:0:14369:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933301998200/0x2bea1a57ca34485a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847098:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847105:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847112:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847118:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789428035.847123:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847130:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847143:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9700) 00010000:00010000:0.0:1789428035.847146:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428035.847151:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847157:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34484c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847169:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847224:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847232:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847246:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789428035.847249:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847257:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847348:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff933414dc9900) 00010000:00010000:0.0:1789428035.847352:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428035.847355:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847363:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344853 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847397:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998c00/0x2bea1a57ca344845 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be8 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847409:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998200/0x2bea1a57ca34485a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be8 expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.847416:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9334220b8300) 00010000:00010000:0.0:1789428035.847418:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789428035.847421:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301998200, rc 0) 00000100:00100000:0.0:1789428035.847490:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+11:14416:x1876350857236480:12345-192.168.201.55@tcp:101:bash.0 Request processed in 937us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428035.847498:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 27 00000100:00100000:1.0:1789428035.856118:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428035.856245:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857236736 00000100:00100000:0.0:1789428035.856278:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857236736 00000100:00100000:0.0:1789428035.856352:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 28 00000100:00100000:0.0:1789428035.856362:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+11:14416:x1876350857236736:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:0.0:1789428035.856384:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428035.856408:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998c00/0x2bea1a57ca344861 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bef expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.856550:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.856565:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be1 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.856590:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.856628:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be1 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.856643:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be1 expref: 11 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428035.856655:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93344198d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14368:1876350877149184:192.168.201.55@tcp:104: 00000100:00100000:0.0:1789428035.856747:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff933433db0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789428035.863993:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428035.868214:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857236864 00000100:00100000:3.0:1789428035.868229:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857236864 00010000:00010000:3.0:1789428035.868275:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be1 expref: 12 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428035.868325:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:3.0:1789428035.868359:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+12:2356:x1876350857236864:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428035.868380:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428035.868388:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be1 expref: 12 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.868403:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be1 expref: 12 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.868428:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9334220b8300) 00010000:00010000:3.0:1789428035.868434:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.868444:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.868446:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4000/0x2bea1a57ca34483e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8be1 expref: 12 pid: 14370 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.868452:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428035.868461:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93344198d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14368:1876350877149184:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789428035.868470:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789428035.868484:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.868493:0:14368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.868513:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428035.868532:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+11:2356:x1876350857236864:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 175us (4549us total) trans 0 rc 0/0 00010000:00010000:0.0:1789428035.868535:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428035.868539:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00010000:00010000:0.0:1789428035.868544:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.868552:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869294:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869306:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869313:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428035.869323:0:14368:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789428035.869365:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869372:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869391:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869397:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789428035.869402:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869411:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869422:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9334220b8300) 00010000:00010000:0.0:1789428035.869425:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428035.869430:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869436:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344868 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789428035.869447:0:14368:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d5ec394a reply state 0000000019114e77 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428035.869457:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789428035.869491:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998c00/0x2bea1a57ca344861 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bef expref: 14 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869507:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bef expref: 13 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428035.869514:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:0.0:1789428035.869522:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789428035.869525:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301999600, rc 0) 00000100:00100000:0.0:1789428035.869582:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+14:14416:x1876350857236736:12345-192.168.201.55@tcp:101:bash.0 Request processed in 13220us (13473us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789428035.869590:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 28 00010000:00010000:3.0:1789428035.875099:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.875120:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.875130:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.875159:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789428035.875166:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.875196:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.875216:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff933414dc9900) 00010000:00010000:3.0:1789428035.875219:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789428035.875225:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428035.875233:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999400/0x2bea1a57ca34486f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428035.901446:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428035.901561:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857236992 00000100:00100000:2.0:1789428035.901572:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857236992 00000100:00100000:2.0:1789428035.901636:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:2.0:1789428035.901646:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+13:14416:x1876350857236992:12345-192.168.201.55@tcp:101:bash.0 00010000:00010000:2.0:1789428035.901680:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428035.901701:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca344884 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bf6 expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.901766:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.901780:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.901791:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428035.901860:0:16404:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789428035.901864:0:16404:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789428035.901884:0:16404:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.901894:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.901918:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca344884 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bf6 expref: 15 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.901936:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bf6 expref: 14 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428035.901944:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:2.0:1789428035.901947:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789428035.901951:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4600, rc 0) 00000100:00100000:2.0:1789428035.902248:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+14:14416:x1876350857236992:12345-192.168.201.55@tcp:101:bash.0 Request processed in 601us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428035.902255:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:1.0:1789428035.909761:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428035.914889:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857237248 00000100:00100000:3.0:1789428035.914905:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857237248 00000100:00100000:3.0:1789428035.915004:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:3.0:1789428035.915017:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+14:14416:x1876350857237248:12345-192.168.201.55@tcp:35:bash.0 00000100:00100000:3.0:1789428035.915423:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+15:14416:x1876350857237248:12345-192.168.201.55@tcp:35:bash.0 Request processed in 407us (5670us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789428035.915431:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:3.0:1789428036.028756:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428036.029045:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857237504 00000100:00100000:2.0:1789428036.029057:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857237504 00000100:00100000:2.0:1789428036.029125:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00100000:2.0:1789428036.029136:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+15:14426:x1876350857237504:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:2.0:1789428036.029161:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428036.029217:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca344892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8bfd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428036.029317:0:14370:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789428036.029472:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca344892 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bfd expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.029487:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933414dc9700) 00010000:00010000:2.0:1789428036.029489:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789428036.029495:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca344892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bfd expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.029509:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d4800, rc 0) 00000100:00100000:2.0:1789428036.029565:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+16:14426:x1876350857237504:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 430us (818us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789428036.029572:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00100000:1.0:1789428036.034634:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428036.035364:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857237760 00000100:00100000:2.0:1789428036.035376:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857237760 00000100:00100000:2.0:1789428036.035497:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:2.0:1789428036.035509:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10605fa2-3254-437c-8111-34c57e564568+16:14426:x1876350857237760:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:2.0:1789428036.037468:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10605fa2-3254-437c-8111-34c57e564568+17:14426:x1876350857237760:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 1951us (2834us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789428036.037484:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:2.0:1789428036.041733:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877149312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789428036.041805:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428036.041898:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877149312 00000100:00100000:2.0:1789428036.041907:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877149312 00000100:00100000:2.0:1789428036.041961:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789428036.041969:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877149312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789428036.042005:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789428036.042047:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876350877149312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428036.042054:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789428036.042103:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876350877149312:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789428036.042386:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789428036.042485:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877149568:0@lo:400:kworker.0 00000100:00100000:1.0:1789428036.042519:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428036.042544:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789428036.042550:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877149696:0@lo:400:kworker.0 00000100:00100000:1.0:1789428036.042575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428036.042615:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877149568 00000100:00100000:1.0:1789428036.042620:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877149568 00000100:00100000:1.0:1789428036.042655:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789428036.042661:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877149568:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789428036.043093:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428036.043107:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877149696 00000100:00100000:0.0:1789428036.043112:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877149696 00000100:00100000:0.0:1789428036.043148:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789428036.043156:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877149696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428036.043230:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877149696:12345-0@lo:400:kworker.0 Request processed in 75us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428036.043237:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789428036.043343:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877149696:0@lo:400:kworker.0 00000100:00100000:3.0:1789428036.043704:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877149440:0@lo:400:kworker.0 00000100:00100000:3.0:1789428036.043746:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428036.043785:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877149952:0@lo:400:kworker.0 00000100:00100000:3.0:1789428036.043814:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428036.043849:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789428036.043857:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877149824:0@lo:400:kworker.0 00000100:00100000:3.0:1789428036.043881:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428036.043910:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877149952 00000100:00100000:3.0:1789428036.043914:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877149952 00000100:00080000:3.0:1789428036.043933:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428036.043958:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877149824 00000100:00100000:3.0:1789428036.043961:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877149824 00000100:00080000:3.0:1789428036.043974:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428036.043982:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789428036.043989:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877149952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428036.044027:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877149952:12345-0@lo:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428036.044034:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789428036.044064:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877149952:0@lo:400:kworker.0 00000100:00100000:3.0:1789428036.044094:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789428036.044101:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877149824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428036.044135:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877149824:12345-0@lo:400:kworker.0 Request processed in 35us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428036.044141:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789428036.044164:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877149824:0@lo:400:kworker.0 00000100:00100000:1.0:1789428036.046290:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877149568:12345-0@lo:400:kworker.0 Request processed in 3621us (3761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428036.046306:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789428036.046377:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877149568:0@lo:400:kworker.0 00000100:00100000:0.0:1789428036.047096:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877149440 00000100:00100000:0.0:1789428036.047105:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877149440 00000100:00100000:0.0:1789428036.047156:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789428036.047165:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3299:x1876350877149440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428036.047487:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3299:x1876350877149440:12345-0@lo:400:kworker.0 Request processed in 322us (3739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428036.047494:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789428036.051102:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877149440:0@lo:400:kworker.0 00000100:00100000:1.0:1789428036.094324:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428036.094958:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857238016 00000100:00100000:3.0:1789428036.094969:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857238016 00000100:00100000:3.0:1789428036.095032:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 31 00000100:00100000:3.0:1789428036.095041:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+17:14429:x1876350857238016:12345-192.168.201.55@tcp:101:lfs.0 00010000:00010000:3.0:1789428036.095082:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428036.095102:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c04 expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.099325:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7400/0x2bea1a57ca3448a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.099360:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7400/0x2bea1a57ca3448a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.099376:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7400/0x2bea1a57ca3448a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789428036.099394:0:16404:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789428036.099569:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c04 expref: 20 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.099590:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7400/0x2bea1a57ca3448a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c04 expref: 19 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.099599:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:3.0:1789428036.099602:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789428036.099606:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7400, rc 0) 00000100:00100000:3.0:1789428036.099681:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+19:14429:x1876350857238016:12345-192.168.201.55@tcp:101:lfs.0 Request processed in 4640us (5366us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789428036.099703:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 31 00000100:00100000:3.0:1789428036.103556:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428036.105777:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857238144 00000100:00100000:0.0:1789428036.105795:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857238144 00000100:00100000:0.0:1789428036.105886:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 32 00000100:00100000:0.0:1789428036.105895:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+19:14429:x1876350857238144:12345-192.168.201.55@tcp:54:lfs.0 00010000:00010000:0.0:1789428036.105966:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.105999:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.106011:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.106041:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.106048:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.106055:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.106060:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999000 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:0.0:1789428036.106064:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.106072:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.106083:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:0.0:1789428036.106086:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789428036.106090:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.106096:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca3448b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428036.106203:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+19:14429:x1876350857238144:12345-192.168.201.55@tcp:54:lfs.0 Request processed in 308us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428036.106215:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 32 00000100:00100000:0.0:1789428036.108701:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428036.111447:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428036.111537:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857238528 00000100:00100000:0.0:1789428036.111555:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857238528 00000100:00100000:0.0:1789428036.111633:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:0.0:1789428036.111644:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+19:14429:x1876350857238528:12345-192.168.201.55@tcp:35:lfs.0 00000100:00100000:0.0:1789428036.112073:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+20:14429:x1876350857238528:12345-192.168.201.55@tcp:35:lfs.0 Request processed in 428us (901us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789428036.112081:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:2.0:1789428036.112989:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857238272 00000100:00100000:2.0:1789428036.113001:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857238272 00000100:00100000:2.0:1789428036.113088:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:2.0:1789428036.113099:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10605fa2-3254-437c-8111-34c57e564568+20:2355:x1876350857238272:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428036.113114:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428036.113141:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7400/0x2bea1a57ca3448a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c04 expref: 20 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.113161:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:2.0:1789428036.113166:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428036.113231:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10605fa2-3254-437c-8111-34c57e564568+19:2355:x1876350857238272:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 133us (4552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428036.114491:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 0 00000040:00080000:2.0:1789428036.233874:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789428036.426526:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428036.495869:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428036.496134:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857238784 00000100:00100000:2.0:1789428036.496149:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857238784 00000100:00100000:2.0:1789428036.496277:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:2.0:1789428036.496291:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+19:14460:x1876350857238784:12345-192.168.201.55@tcp:101:cat.0 00010000:00010000:2.0:1789428036.496340:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428036.496372:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3448bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.496529:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3448c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.496549:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3448c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.496566:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3448c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428036.496581:0:14370:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789428036.496782:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca3448bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c0b expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.496809:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3448c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c0b expref: 21 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.496942:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:2.0:1789428036.496967:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789428036.496972:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5000, rc 0) 00000100:00100000:2.0:1789428036.497073:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+21:14460:x1876350857238784:12345-192.168.201.55@tcp:101:cat.0 Request processed in 785us (1220us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789428036.497082:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 33 00000100:00100000:2.0:1789428036.509554:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428036.509624:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428036.509758:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857238912 00000100:00100000:3.0:1789428036.509795:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857238912 00000100:00100000:3.0:1789428036.509912:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:3.0:1789428036.509926:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10605fa2-3254-437c-8111-34c57e564568+21:2356:x1876350857238912:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428036.509949:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428036.509984:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca3448c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c0b expref: 21 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.510021:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:3.0:1789428036.510028:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428036.510102:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10605fa2-3254-437c-8111-34c57e564568+20:2356:x1876350857238912:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 177us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428036.510111:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:0.0:1789428036.512264:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857239168 00000100:00100000:0.0:1789428036.512289:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857239168 00000100:00100000:0.0:1789428036.512402:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:0.0:1789428036.512416:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+20:14460:x1876350857239168:12345-192.168.201.55@tcp:35:cat.0 00000100:00100000:0.0:1789428036.514917:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+21:14460:x1876350857239168:12345-192.168.201.55@tcp:35:cat.0 Request processed in 2483us (5271us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789428036.514935:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 8 00000100:00100000:0.0:1789428036.609291:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428036.609375:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857239424 00000100:00100000:3.0:1789428036.609389:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857239424 00000100:00100000:3.0:1789428036.609644:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:3.0:1789428036.609658:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+21:14466:x1876350857239424:12345-192.168.201.55@tcp:101:dd.0 00010000:00010000:3.0:1789428036.609694:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428036.609724:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7600/0x2bea1a57ca3448d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c12 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.609875:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.609894:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bef expref: 22 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.609904:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bf6 expref: 22 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.609939:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.609986:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bf6 expref: 22 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.610002:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bf6 expref: 22 pid: 16404 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428036.610019:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14369:1876350877150080:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789428036.610156:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bef expref: 22 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.610166:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bef expref: 22 pid: 14368 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428036.610240:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14369:1876350877150208:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789428036.610287:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff93340701b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789428036.613960:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14369:1876350877150080:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789428036.613981:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14369:1876350877150208:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789428036.614017:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428036.615227:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428036.615274:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428036.615317:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857239552 00000100:00100000:2.0:1789428036.615341:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857239552 00010000:00010000:2.0:1789428036.615396:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bf6 expref: 23 pid: 16404 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428036.615445:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857239680 00000100:00100000:2.0:1789428036.615449:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857239680 00010000:00010000:2.0:1789428036.615465:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bef expref: 24 pid: 14368 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428036.615486:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:2.0:1789428036.615495:0:14355:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789428036.615503:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9334335a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10605fa2-3254-437c-8111-34c57e564568+24:2357:x1876350857239552:12345-192.168.201.55@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789428036.615517:0:14355:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789428036.615540:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428036.615552:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bf6 expref: 24 pid: 16404 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.615587:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bf6 expref: 24 pid: 16404 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.615615:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34488b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bf6 expref: 24 pid: 16404 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.615635:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:0.0:1789428036.615641:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.615652:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.615660:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428036.615701:0:14354:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789428036.615716:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:3.0:1789428036.615732:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10605fa2-3254-437c-8111-34c57e564568+23:2357:x1876350857239680:12345-192.168.201.55@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789428036.615740:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9334335a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10605fa2-3254-437c-8111-34c57e564568+23:2357:x1876350857239552:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 241us (521us total) trans 0 rc 0/0 00010000:00010000:3.0:1789428036.615744:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789428036.615752:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00010000:00010000:3.0:1789428036.615753:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bef expref: 23 pid: 14368 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.615768:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bef expref: 23 pid: 14368 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.615783:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344876 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8bef expref: 22 pid: 14368 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.615797:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:3.0:1789428036.615801:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.615826:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.615836:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.615870:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428036.615899:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10605fa2-3254-437c-8111-34c57e564568+21:2357:x1876350857239680:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 168us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428036.615906:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00010000:00010000:0.0:1789428036.616340:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.616351:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428036.616377:0:14369:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789428036.617112:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7600/0x2bea1a57ca3448d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c12 expref: 22 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.617134:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7c00/0x2bea1a57ca3448d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c12 expref: 21 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.617153:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:0.0:1789428036.617156:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789428036.617159:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7c00, rc 0) 00000100:00100000:0.0:1789428036.617408:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+21:14466:x1876350857239424:12345-192.168.201.55@tcp:101:dd.0 Request processed in 7752us (8130us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789428036.617417:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 34 00000100:00100000:0.0:1789428036.626023:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428036.626152:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857239936 00000100:00100000:2.0:1789428036.626204:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857239936 00000100:00100000:2.0:1789428036.626285:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 35 00000100:00100000:2.0:1789428036.626296:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+21:14466:x1876350857239936:12345-192.168.201.55@tcp:36:dd.0 00010000:00010000:2.0:1789428036.626672:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.626694:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.626708:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789428036.626789:0:14370:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789428036.626819:0:14370:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b2430012 reply state 000000006b311997 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428036.626828:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789428036.626956:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+24:14466:x1876350857239936:12345-192.168.201.55@tcp:36:dd.0 Request processed in 656us (942us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789428036.626964:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 35 00000020:00080000:2.0:1789428036.626971:0:14370:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789428036.630711:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00010000:00010000:2.0:1789428036.631042:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.631059:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.631070:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.631077:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d5800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428036.631084:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.631094:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.631115:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:2.0:1789428036.631119:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428036.631124:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428036.631132:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca3448e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428036.631333:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857240064 00000100:00100000:1.0:1789428036.631347:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857240064 00000100:00100000:1.0:1789428036.631425:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:1.0:1789428036.631438:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+23:14466:x1876350857240064:12345-192.168.201.55@tcp:101:dd.0 00010000:00010000:1.0:1789428036.631474:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428036.631514:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448ed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c19 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428036.631593:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c19 expref: 24 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428036.631611:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c19 expref: 24 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428036.631636:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:1.0:1789428036.631640:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789428036.631643:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700c00, rc 0) 00000100:00100000:1.0:1789428036.631728:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+24:14466:x1876350857240064:12345-192.168.201.55@tcp:101:dd.0 Request processed in 292us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428036.631736:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 36 00000100:00100000:1.0:1789428036.645883:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428036.646069:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857240320 00000100:00100000:0.0:1789428036.646084:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857240320 00000100:00100000:0.0:1789428036.646221:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:0.0:1789428036.646235:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10605fa2-3254-437c-8111-34c57e564568+24:14466:x1876350857240320:12345-192.168.201.55@tcp:103:dd.0 00010000:00010000:0.0:1789428036.646270:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428036.646304:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448ed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c19 expref: 24 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428036.646338:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:0.0:1789428036.646345:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428036.646449:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10605fa2-3254-437c-8111-34c57e564568+23:14466:x1876350857240320:12345-192.168.201.55@tcp:103:dd.0 Request processed in 217us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428036.646459:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:1.0:1789428036.649523:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428036.649625:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857240448 00000100:00100000:3.0:1789428036.649639:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857240448 00000100:00100000:3.0:1789428036.649717:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00100000:3.0:1789428036.649758:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+23:14466:x1876350857240448:12345-192.168.201.55@tcp:58:dd.0 00010000:00010000:3.0:1789428036.649907:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.649931:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428036.649947:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789428036.651080:0:16404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428036.651311:0:16404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789428036.651413:0:16404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789428036.651592:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+23:14466:x1876350857240448:12345-192.168.201.55@tcp:58:dd.0 Request processed in 1831us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428036.651606:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 37 00000100:00100000:2.0:1789428036.656001:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428036.656211:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857240576 00000100:00100000:1.0:1789428036.656242:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857240576 00000100:00100000:1.0:1789428036.656338:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 38 00000100:00100000:1.0:1789428036.656351:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+23:14466:x1876350857240576:12345-192.168.201.55@tcp:101:dd.0 00010000:00010000:1.0:1789428036.656382:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428036.656415:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c20 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428036.656557:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428036.656571:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448fb lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c20 expref: 24 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428036.656595:0:14368:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428036.656610:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448fb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c20 expref: 24 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428036.656626:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:1.0:1789428036.656630:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789428036.656633:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448fb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c20 expref: 24 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428036.656642:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700c00, rc 0) 00000100:00100000:1.0:1789428036.656747:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+24:14466:x1876350857240576:12345-192.168.201.55@tcp:101:dd.0 Request processed in 397us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428036.656777:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 38 00000040:00080000:2.0:1789428037.257972:0:14400:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789428037.257987:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789428037.258034:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789428037.258046:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789428037.258269:0:14400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14400:1876350877150336:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789428037.258762:0:14400:0:(client.c:2716:ptlrpc_set_wait()) set ffff933410cfdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428037.269249:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428037.269364:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857240704 00000100:00100000:0.0:1789428037.269378:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857240704 00000100:00100000:0.0:1789428037.269478:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:0.0:1789428037.269492:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10605fa2-3254-437c-8111-34c57e564568+25:14467:x1876350857240704:12345-192.168.201.55@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789428037.269614:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10605fa2-3254-437c-8111-34c57e564568+25:14467:x1876350857240704:12345-192.168.201.55@tcp:900:lhsmtool_posix.0 Request processed in 126us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.269640:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00080000:1.0:1789428037.270369:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428037.270921:0:14400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14400:1876350877150336:192.168.201.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789428037.275198:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.275257:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857240832 00000100:00100000:3.0:1789428037.275270:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857240832 00000100:00100000:3.0:1789428037.275984:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 39 00000100:00100000:3.0:1789428037.276002:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+24:14467:x1876350857240832:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789428037.276081:0:16404:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789428037.276279:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+24:14467:x1876350857240832:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 283us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428037.276288:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 39 00000100:00100000:0.0:1789428037.283413:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428037.283588:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857240960 00000100:00100000:1.0:1789428037.283603:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857240960 00000100:00100000:1.0:1789428037.283882:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 40 00000100:00100000:1.0:1789428037.283896:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+24:14467:x1876350857240960:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789428037.284968:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.285112:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.285133:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286349:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286375:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286388:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286433:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286443:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286449:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789428037.286517:0:14368:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789428037.286522:0:14368:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789428037.286538:0:14368:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286563:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286570:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286577:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286583:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428037.286588:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286597:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286609:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9334155e4300) 00010000:00010000:1.0:1789428037.286613:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428037.286618:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286625:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344902 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286641:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286658:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286664:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286670:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428037.286673:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286680:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286688:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9334155e4a00) 00010000:00010000:1.0:1789428037.286691:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428037.286694:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286700:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca344909 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286715:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286721:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286727:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286733:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428037.286742:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286749:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286757:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:1.0:1789428037.286759:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428037.286762:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.286768:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca344910 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428037.286874:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+24:14467:x1876350857240960:12345-192.168.201.55@tcp:34:lhsmtool_posix.0 Request processed in 2976us (3471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.286885:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 40 00000100:00100000:2.0:1789428037.298129:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.298931:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857241216 00000100:00100000:3.0:1789428037.298948:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857241216 00000100:00100000:3.0:1789428037.299122:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 41 00000100:00100000:3.0:1789428037.299138:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+24:14467:x1876350857241216:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789428037.299217:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428037.299246:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7000/0x2bea1a57ca344917 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.299988:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300012:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300026:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789428037.300038:0:14370:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789428037.300157:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300165:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300227:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300234:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701800 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428037.300239:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300248:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300261:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:1.0:1789428037.300265:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789428037.300271:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300277:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701800/0x2bea1a57ca34491e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300341:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7000/0x2bea1a57ca344917 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c27 expref: 26 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300354:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9334155e4300) 00010000:00010000:1.0:1789428037.300357:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789428037.300361:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7000/0x2bea1a57ca344917 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c27 expref: 26 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.300372:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9334421c7000, rc 0) 00000100:00100000:1.0:1789428037.300462:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+25:14467:x1876350857241216:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 1329us (2349us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789428037.300481:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 41 00000100:00100000:0.0:1789428037.317410:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.317534:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857241344 00000100:00100000:3.0:1789428037.317560:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857241344 00000100:00100000:3.0:1789428037.317658:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:3.0:1789428037.317671:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93344198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+25:14467:x1876350857241344:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789428037.317719:0:14369:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789428037.317936:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93344198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+25:14467:x1876350857241344:12345-192.168.201.55@tcp:53:lhsmtool_posix.0 Request processed in 268us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428037.317945:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 42 00000100:00100000:2.0:1789428037.327318:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428037.327872:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857241600 00000100:00100000:0.0:1789428037.327888:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857241600 00000100:00100000:0.0:1789428037.327983:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 43 00000100:00100000:0.0:1789428037.327995:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+25:14467:x1876350857241600:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789428037.328025:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428037.328053:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca34492c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c2e expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789428037.329376:0:16404:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1789428037.329390:0:16404:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789428037.329454:0:16404:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789428037.330376:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344933 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.330402:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.330417:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.330746:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca34492c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c2e expref: 28 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.330774:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344933 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c2e expref: 27 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.330793:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933414dc9000) 00010000:00010000:0.0:1789428037.330796:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789428037.330800:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933301999000, rc 0) 00000100:00100000:0.0:1789428037.331032:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+27:14467:x1876350857241600:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 3037us (3740us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789428037.331043:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 43 00000100:00100000:2.0:1789428037.337014:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.337149:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857241856 00000100:00100000:3.0:1789428037.337164:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857241856 00000100:00100000:3.0:1789428037.337501:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 44 00000100:00100000:3.0:1789428037.337514:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+27:14467:x1876350857241856:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789428037.337620:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428037.337658:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999000/0x2bea1a57ca344933 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c2e expref: 27 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.337694:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933414dc9000) 00010000:00010000:3.0:1789428037.337708:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789428037.337740:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.337778:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.337791:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.338814:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.338843:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.338857:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.338942:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.338949:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.338955:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.338961:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c7e00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789428037.338964:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.338971:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.338984:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9334220b8300) 00010000:00010000:3.0:1789428037.339001:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789428037.339007:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.339013:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c7e00/0x2bea1a57ca344941 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.339027:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.339033:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.339039:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.339044:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c6a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:3.0:1789428037.339046:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.339052:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.339059:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5fb095fa (ffff933410b41000) 00010000:00010000:3.0:1789428037.339061:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789428037.339064:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.339069:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6a00/0x2bea1a57ca344948 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5fb095fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428037.339649:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+26:14467:x1876350857241856:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 2130us (2644us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789428037.339669:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 44 00000100:00100000:1.0:1789428037.342626:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428037.342870:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857241984 00000100:00100000:2.0:1789428037.342884:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857241984 00000100:00100000:2.0:1789428037.343011:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 45 00000100:00100000:2.0:1789428037.343024:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+26:14467:x1876350857241984:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428037.343064:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428037.343095:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34494f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c35 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.343142:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344956 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.343160:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344956 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.343197:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344956 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.343354:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4800/0x2bea1a57ca34494f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c35 expref: 28 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.343386:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5800/0x2bea1a57ca344956 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c35 expref: 27 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.343396:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:2.0:1789428037.343400:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789428037.343404:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5800, rc 0) 00000100:00100000:2.0:1789428037.343491:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+27:14467:x1876350857241984:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 470us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.343499:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 45 00000100:00100000:0.0:1789428037.347169:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428037.347798:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857242240 00000100:00100000:1.0:1789428037.347817:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857242240 00000100:00100000:1.0:1789428037.347911:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 46 00000100:00100000:1.0:1789428037.347925:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+27:14467:x1876350857242240:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789428037.348072:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.348095:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.348111:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789428037.350082:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1789428037.350107:0:14368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 492284931155ns, next at 493284926227ns, rc = 0 00000004:00010000:1.0:1789428037.350279:0:14368:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004579df0e reply state 00000000bff0a500 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428037.350290:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789428037.350468:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343aca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+29:14467:x1876350857242240:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 2539us (3306us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789428037.350479:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 46 00000100:00100000:0.0:1789428037.353070:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00010000:00010000:1.0:1789428037.353699:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.353719:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.353753:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.353987:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420701200 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428037.353992:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.354000:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.354023:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:1.0:1789428037.354026:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789428037.354032:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.354040:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420701200/0x2bea1a57ca34495d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428037.354234:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857242368 00000100:00100000:3.0:1789428037.354250:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857242368 00000100:00100000:1.0:1789428037.354376:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00100000:1.0:1789428037.354385:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+28:14467:x1876350857242368:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789428037.354412:0:16404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428037.354431:0:16404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c3c expref: -99 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.354505:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c3c expref: 29 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.354516:0:16404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c3c expref: 29 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.354543:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:1.0:1789428037.354546:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789428037.354549:0:16404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420700800, rc 0) 00000100:00100000:1.0:1789428037.354650:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+29:14467:x1876350857242368:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 264us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.354658:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 47 00000100:00100000:3.0:1789428037.357157:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428037.357404:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857242496 00000100:00100000:0.0:1789428037.357419:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857242496 00000100:00080000:1.0:1789428037.357472:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428037.357516:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:0.0:1789428037.357529:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10605fa2-3254-437c-8111-34c57e564568+5:2356:x1876350857242496:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789428037.357993:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10605fa2-3254-437c-8111-34c57e564568+6:2356:x1876350857242496:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 464us (849us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789428037.358002:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 12 00000100:00100000:0.0:1789428037.360215:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428037.361745:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857242752 00000100:00100000:2.0:1789428037.361767:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857242752 00000100:00100000:2.0:1789428037.361878:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:2.0:1789428037.361890:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10605fa2-3254-437c-8111-34c57e564568+29:14467:x1876350857242752:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789428037.362277:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10605fa2-3254-437c-8111-34c57e564568+30:14467:x1876350857242752:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 387us (2110us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789428037.362287:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 9 00000100:00100000:2.0:1789428037.365145:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.365541:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857243008 00000100:00100000:3.0:1789428037.367380:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857243008 00000100:00100000:3.0:1789428037.367498:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:3.0:1789428037.367510:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+30:14467:x1876350857243008:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789428037.367687:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+30:14467:x1876350857243008:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 176us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428037.367695:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 48 00000100:00100000:1.0:1789428037.372647:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:2.0:1789428037.373367:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857243136 00000100:00100000:2.0:1789428037.373384:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857243136 00000100:00100000:2.0:1789428037.373520:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:2.0:1789428037.373533:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+30:14467:x1876350857243136:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428037.373570:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428037.373602:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34496b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c43 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.373726:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344972 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.373746:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.373761:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428037.373810:0:14370:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789428037.373834:0:14370:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.373867:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d4600/0x2bea1a57ca34496b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c43 expref: 32 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.373891:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344972 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c43 expref: 31 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.373900:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:2.0:1789428037.373903:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789428037.373908:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93340e1d5000, rc 0) 00000100:00100000:2.0:1789428037.373999:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+31:14467:x1876350857243136:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 467us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428037.374008:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 49 00000100:00100000:0.0:1789428037.378273:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428037.378330:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857243264 00000100:00100000:1.0:1789428037.378344:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857243264 00000100:00100000:1.0:1789428037.378414:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:1.0:1789428037.378432:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+6:2357:x1876350857243264:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789428037.378458:0:15057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428037.378587:0:15057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x954cd080504a8c4a expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789428037.378622:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa88145, blocks: 0x1 00010000:00010000:1.0:1789428037.378645:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789428037.378649:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428037.378658:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c4a expref: 7 pid: 15057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.378729:0:15057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c4a expref: 7 pid: 15057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.378763:0:15057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933420701200, rc 0) 00000100:00100000:1.0:1789428037.378908:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+7:2357:x1876350857243264:12345-192.168.201.55@tcp:101:lhsmtool_posix.0 Request processed in 483us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.378916:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:0.0:1789428037.381474:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428037.381651:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857243520 00000100:00100000:1.0:1789428037.381665:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857243520 00000100:00100000:1.0:1789428037.381736:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00100000:1.0:1789428037.381747:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+31:14467:x1876350857243520:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789428037.382008:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+31:14467:x1876350857243520:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 255us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.382014:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 50 00000100:00100000:3.0:1789428037.384239:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428037.384411:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857243648 00000100:00100000:1.0:1789428037.384424:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857243648 00000100:00100000:2.0:1789428037.384569:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:2.0:1789428037.384584:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+31:14467:x1876350857243648:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789428037.433103:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1789428037.433136:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1789428037.433144:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1789428037.433150:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789428037.433202:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1789428037.433224:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1789428037.433242:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789428037.433495:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877150464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789428037.433589:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428037.433828:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877150464 00000100:00100000:3.0:1789428037.433839:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877150464 00000100:00100000:3.0:1789428037.433903:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428037.433914:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877150464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789428037.434123:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789428037.434126:0:15056:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789428037.434128:0:15056:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789428037.434130:0:15056:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789428037 -> 1789428037 00002000:00010000:3.0:1789428037.434148:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789428037.434370:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1876350877150464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 457us (780us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789428037.434378:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1789428037.434469:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff933420ed3100/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789428037.434472:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10605fa2-3254-437c-8111-34c57e564568+14:14467:x1876350857243648:12345-192.168.201.55@tcp:44:lhsmtool_posix.0 Request processed in 49890us (50244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.434475:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877150464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789428037.434481:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 51 00000100:00100000:0.0:1789428037.436585:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428037.436811:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857243776 00000100:00100000:1.0:1789428037.436822:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857243776 00000100:00100000:1.0:1789428037.436875:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:1.0:1789428037.436882:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+7:2354:x1876350857243776:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789428037.437001:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+7:2354:x1876350857243776:12345-192.168.201.55@tcp:16:lhsmtool_posix.0 Request processed in 119us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.437009:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:2.0:1789428037.438865:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428037.439014:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857244032 00000100:00100000:0.0:1789428037.439045:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857244032 00000100:00100000:0.0:1789428037.439111:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 52 00000100:00100000:0.0:1789428037.439123:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+14:14467:x1876350857244032:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789428037.439232:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428037.439264:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93340e1d5000/0x2bea1a57ca344972 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c43 expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.439284:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:0.0:1789428037.439289:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789428037.439338:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.439353:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.439362:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789428037.439600:0:14369:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cc122935 reply state 00000000490ccc91 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428037.439611:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789428037.439911:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10605fa2-3254-437c-8111-34c57e564568+15:14467:x1876350857244032:12345-192.168.201.55@tcp:36:lhsmtool_posix.0 Request processed in 789us (1058us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789428037.439917:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 52 00000100:00100000:2.0:1789428037.442159:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.442277:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857244160 00000100:00100000:3.0:1789428037.442289:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857244160 00000100:00100000:3.0:1789428037.442404:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:3.0:1789428037.442459:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10605fa2-3254-437c-8111-34c57e564568+7:2357:x1876350857244160:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1789428037.442799:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789428037.442815:0:15055:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789428037.442820:0:15055:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789428036 00002000:00010000:3.0:1789428037.442823:0:15055:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789428036 00002000:00010000:3.0:1789428037.442825:0:15055:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789428037 -> 1789428036 00002000:00010000:3.0:1789428037.442827:0:15055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789428037.442907:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10605fa2-3254-437c-8111-34c57e564568+8:2357:x1876350857244160:12345-192.168.201.55@tcp:2:lhsmtool_posix.0 Request processed in 450us (764us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789428037.442916:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 16 00010000:00010000:1.0:1789428037.443043:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.443053:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.443061:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428037.443068:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.443078:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.443098:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:1.0:1789428037.443102:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428037.443108:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.443115:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301999600/0x2bea1a57ca344980 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428037.444993:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.445058:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857244288 00000100:00100000:3.0:1789428037.445072:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857244288 00000100:00100000:3.0:1789428037.445223:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:3.0:1789428037.445236:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10605fa2-3254-437c-8111-34c57e564568+8:2356:x1876350857244288:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789428037.445293:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.445325:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428037.445335:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428037.445344:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.445394:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.445430:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.445437:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.445443:0:15056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.445447:0:15056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c6a00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428037.445451:0:15056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.445457:0:15056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.445471:0:15056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.445476:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca344987 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428037.445587:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10605fa2-3254-437c-8111-34c57e564568+8:2356:x1876350857244288:12345-192.168.201.55@tcp:1:lhsmtool_posix.0 Request processed in 353us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428037.445596:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:0.0:1789428037.447784:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428037.447849:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857244544 00000100:00100000:1.0:1789428037.447863:0:16404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857244544 00000100:00100000:1.0:1789428037.447931:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 53 00000100:00100000:1.0:1789428037.447942:0:16404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+14:14467:x1876350857244544:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789428037.448058:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.448076:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.448104:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.448451:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.448462:0:16404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c3c expref: 15 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.448470:0:16404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.448523:0:16404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c3c expref: 15 pid: 16404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.448539:0:16404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c3c expref: 15 pid: 16404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428037.448770:0:16404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16404:1876350877150592:192.168.201.55@tcp:104: 00000100:00100000:1.0:1789428037.448921:0:16404:0:(client.c:2716:ptlrpc_set_wait()) set ffff933421e649c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789428037.449459:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428037.451563:0:16404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16404:1876350877150592:192.168.201.55@tcp:104: 00010000:00010000:1.0:1789428037.451606:0:16404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428037.452074:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428037.452232:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857244672 00000100:00100000:1.0:1789428037.452239:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857244672 00010000:00010000:1.0:1789428037.452283:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c3c expref: 16 pid: 16404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428037.452362:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 13 00000100:00100000:1.0:1789428037.452374:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10605fa2-3254-437c-8111-34c57e564568+16:2357:x1876350857244672:12345-192.168.201.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789428037.452395:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428037.452404:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c3c expref: 16 pid: 16404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.452418:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c3c expref: 16 pid: 16404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.452445:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700800/0x2bea1a57ca344964 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c3c expref: 16 pid: 16404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.452464:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:1.0:1789428037.452470:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.452487:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.452497:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.452533:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428037.452603:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10605fa2-3254-437c-8111-34c57e564568+15:2357:x1876350857244672:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 230us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.452611:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 13 00010000:00010000:0.0:1789428037.452843:0:16404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.452863:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789428037.453113:0:16404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789428037.453327:0:16404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789428037.453380:0:16404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789428037.453503:0:16404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933301ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16404:1876350877150720:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789428037.453884:0:16404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428037.453939:0:16404:0:(client.c:2716:ptlrpc_set_wait()) set ffff93341d81b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428037.455323:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877150720 00000100:00100000:1.0:1789428037.455347:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877150720 00000100:00100000:1.0:1789428037.455419:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789428037.455430:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16404:x1876350877150720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789428037.455611:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16404:x1876350877150720:12345-0@lo:1000:mdt00_003.0 Request processed in 182us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428037.455619:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428037.455938:0:16404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933301ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16404:1876350877150720:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789428037.456855:0:16404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789428037.456977:0:16404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16404:1876350877150848:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789428037.457050:0:16404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428037.457093:0:16404:0:(client.c:2716:ptlrpc_set_wait()) set ffff933415be1600 going to sleep for 11 seconds 00000100:00100000:1.0:1789428037.457362:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877150848 00000100:00100000:1.0:1789428037.457374:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877150848 00000100:00100000:1.0:1789428037.457432:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789428037.457443:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16404:x1876350877150848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789428037.457684:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16404:x1876350877150848:12345-0@lo:1000:mdt00_003.0 Request processed in 243us (633us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789428037.457693:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428037.458533:0:16404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16404:1876350877150848:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789428037.458591:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458604:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458615:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458622:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700a00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428037.458628:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458638:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458658:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:2.0:1789428037.458661:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789428037.458727:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458762:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700a00/0x2bea1a57ca344995 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458878:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458885:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458890:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458894:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c6c00 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:2.0:1789428037.458897:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458903:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458912:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:2.0:1789428037.458914:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789428037.458921:0:16404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c20 expref: 18 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458933:0:16404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448fb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c20 expref: 18 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.458943:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c20 expref: 18 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.459036:0:16404:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff933420700c00/0x2bea1a57ca3448fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c20 expref: 18 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428037.459052:0:16404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16404:1876350877150976:192.168.201.55@tcp:105: 00000100:00100000:2.0:1789428037.459292:0:16404:0:(client.c:2716:ptlrpc_set_wait()) set ffff933415be1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789428037.463684:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.463741:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857244800 00000100:00100000:3.0:1789428037.463755:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857244800 00000100:00100000:1.0:1789428037.463812:0:16404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16404:1876350877150976:192.168.201.55@tcp:105: 00010000:00010000:1.0:1789428037.463850:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.463865:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9334421c6c00/0x2bea1a57ca3448f4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.463911:0:16404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.463929:0:16404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.463942:0:16404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.463953:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.463977:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.463984:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.463991:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700400 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428037.463996:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464004:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464019:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:1.0:1789428037.464022:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428037.464027:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464032:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700400/0x2bea1a57ca34499c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464044:0:16404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464050:0:16404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464057:0:16404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464062:0:16404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700600 already unused, calling callback (ffffffffc222f4f0) 00010000:00010000:1.0:1789428037.464071:0:16404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464078:0:16404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464086:0:16404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933414dc9a00) 00010000:00010000:1.0:1789428037.464089:0:16404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789428037.464091:0:16404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.464099:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933420700600/0x2bea1a57ca34498e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428037.464331:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:3.0:1789428037.464345:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933406aab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10605fa2-3254-437c-8111-34c57e564568+19:14466:x1876350857244800:12345-192.168.201.55@tcp:49:dd.0 00000040:00080000:1.0:1789428037.464522:0:14400:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789428037.464528:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789428037.464579:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789428037.464589:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789428037.464718:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933406aab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10605fa2-3254-437c-8111-34c57e564568+19:14466:x1876350857244800:12345-192.168.201.55@tcp:49:dd.0 Request processed in 376us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428037.464727:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 10 00000100:00100000:1.0:1789428037.466370:0:16404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10605fa2-3254-437c-8111-34c57e564568+18:14467:x1876350857244544:12345-192.168.201.55@tcp:57:lhsmtool_posix.0 Request processed in 18417us (18586us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789428037.466387:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 53 00000020:00080000:1.0:1789428037.466396:0:16404:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789428037.483995:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.489416:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857245056 00000100:00100000:3.0:1789428037.489438:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857245056 00000100:00100000:3.0:1789428037.489539:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 11 00000100:00100000:3.0:1789428037.489551:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+18:14467:x1876350857245056:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789428037.499750:0:14371:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789428037.500708:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789428037.500807:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.500832:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.500848:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.500859:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.500867:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.500874:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.500923:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789428037.501088:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10605fa2-3254-437c-8111-34c57e564568+20:14467:x1876350857245056:12345-192.168.201.55@tcp:35:lhsmtool_posix.0 Request processed in 11533us (17102us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789428037.501100:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 11 00000020:00080000:0.0:1789428037.501108:0:14371:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789428037.501354:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428037.501364:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.501372:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301998e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428037.501377:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.501387:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.505111:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9334220b8f00) 00010000:00010000:2.0:1789428037.505117:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789428037.505127:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.505136:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933301998e00/0x2bea1a57ca3449a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.505549:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428037.505554:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428037.505557:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428037.659312:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428037.659502:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.667712:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857245184 00000100:00100000:3.0:1789428037.667776:0:15060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857245184 00000100:00100000:3.0:1789428037.667915:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857245312 00000100:00100000:3.0:1789428037.667920:0:15060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857245312 00000100:00100000:3.0:1789428037.667952:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:3.0:1789428037.667963:0:15060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10605fa2-3254-437c-8111-34c57e564568+9:2356:x1876350857245184:12345-192.168.201.55@tcp:4:dd.0 00010000:00010000:3.0:1789428037.668011:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.668039:0:15060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c4a expref: 9 pid: 15057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.668068:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428037.668073:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428037.668078:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.668129:0:15060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c4a expref: 9 pid: 15057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.668146:0:15060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c4a expref: 9 pid: 15057 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428037.668164:0:15060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93343b1b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15060:1876350877151104:192.168.201.55@tcp:104: 00000100:00100000:3.0:1789428037.669435:0:15060:0:(client.c:2716:ptlrpc_set_wait()) set ffff933411b2cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789428037.673074:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428037.677376:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789428037.677405:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789428037.678338:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857245440 00000100:00100000:3.0:1789428037.678357:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857245440 00000100:00100000:0.0:1789428037.678592:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428037.678625:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857245568 00000100:00100000:0.0:1789428037.678630:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857245568 00010000:00010000:0.0:1789428037.678661:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c4a expref: 11 pid: 15057 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428037.678982:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00100000:0.0:1789428037.678996:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10605fa2-3254-437c-8111-34c57e564568+11:2356:x1876350857245568:12345-192.168.201.55@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789428037.679214:0:15060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93343b1b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15060:1876350877151104:192.168.201.55@tcp:104: 00010000:00010000:3.0:1789428037.679246:0:15060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.679350:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428037.679453:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c4a expref: 11 pid: 15057 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.679469:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c4a expref: 11 pid: 15057 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.679500:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000682be6ba/0x2bea1a57ca344979 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.55@tcp remote: 0x954cd080504a8c4a expref: 11 pid: 15057 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.679535:0:14353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428037.679540:0:14353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428037.679547:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.679558:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428037.679592:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789428037.680099:0:15060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.680111:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428037.680664:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10605fa2-3254-437c-8111-34c57e564568+10:2356:x1876350857245568:12345-192.168.201.55@tcp:103:ldlm_bl.0 Request processed in 1664us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428037.680689:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 14 00000100:00100000:1.0:1789428037.685197:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 1 00000100:00100000:1.0:1789428037.685265:0:16602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:10605fa2-3254-437c-8111-34c57e564568+10:2356:x1876350857245312:12345-192.168.201.55@tcp:4:dd.0 00010000:00010000:1.0:1789428037.685342:0:16602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.685367:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428037.685373:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428037.685380:0:16602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428037.685418:0:16602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789428037.880906:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:0.0:1789428037.880931:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1789428037.880940:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1789428037.881140:0:15060:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1789428037.881146:0:15060:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789428036 -> 1789428037 00002000:00010000:2.0:1789428037.881170:0:15060:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1789428037.881229:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.881246:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.881258:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.881267:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c6a00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428037.881273:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.881285:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.881318:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.881326:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428037.881447:0:15060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10605fa2-3254-437c-8111-34c57e564568+8:2356:x1876350857245184:12345-192.168.201.55@tcp:4:dd.0 Request processed in 213478us (222155us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789428037.881459:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 0 00000100:00100000:2.0:1789428037.881498:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:2.0:1789428037.881513:0:15060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10605fa2-3254-437c-8111-34c57e564568+7:2357:x1876350857245440:12345-192.168.201.55@tcp:4:dd.0 00010000:00010000:2.0:1789428037.881566:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.881584:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428037.881589:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428037.881596:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428037.881611:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.882500:0:16602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.882518:0:16602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.882528:0:16602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.882535:0:16602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933420700400 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428037.882539:0:16602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.882549:0:16602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.882565:0:16602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428037.882573:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5791f8/0x2bea1a57ca3449b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428037.882657:0:16602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:10605fa2-3254-437c-8111-34c57e564568+7:2356:x1876350857245312:12345-192.168.201.55@tcp:4:dd.0 Request processed in 197435us (223151us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789428037.882681:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 1 00000001:00080000:0.0:1789428038.029290:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1789428038.029451:0:15060:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1789428038.029464:0:15060:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1789428038.029485:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.029503:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.029515:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.029523:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d4600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428038.029530:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.029542:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.029570:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.029579:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e00af0/0x2bea1a57ca3449b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428038.030067:0:15060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10605fa2-3254-437c-8111-34c57e564568+5:2357:x1876350857245440:12345-192.168.201.55@tcp:4:dd.0 Request processed in 148549us (356997us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789428038.030083:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 2 00000100:00100000:0.0:1789428038.057170:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428038.057249:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428038.057286:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428038.057405:0:16602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857245696 00000100:00100000:1.0:1789428038.057420:0:16602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857245696 00000100:00100000:1.0:1789428038.058119:0:16602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857245952 00000100:00100000:1.0:1789428038.058128:0:16602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857245952 00000100:00100000:0.0:1789428038.061305:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857245824 00000100:00100000:0.0:1789428038.061330:0:15060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857245824 00000100:00100000:0.0:1789428038.061746:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:0.0:1789428038.061760:0:15060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10605fa2-3254-437c-8111-34c57e564568+7:2356:x1876350857245696:12345-192.168.201.55@tcp:4:dd.0 00002000:00010000:0.0:1789428038.061845:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa88145, atime: 0x6aa88144, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1789428038.061856:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.062055:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1789428038.062062:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428038.062071:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.062090:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428038.062915:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:3.0:1789428038.062932:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10605fa2-3254-437c-8111-34c57e564568+8:2356:x1876350857245952:12345-192.168.201.55@tcp:4:dd.0 00010000:00010000:3.0:1789428038.062965:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.062978:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428038.062982:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428038.062986:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.062997:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428038.066994:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428038.067104:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:0.0:1789428038.067995:0:16602:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789428038.068012:0:16602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789428038.068484:0:15061:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789428038.068510:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857246208 00000100:00100000:2.0:1789428038.068526:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857246208 00000100:00100000:2.0:1789428038.068596:0:15061:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789428038.068602:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857246080 00000100:00100000:2.0:1789428038.068605:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857246080 00000100:00100000:2.0:1789428038.089151:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 5 00000100:00100000:2.0:1789428038.089275:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933301ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:10605fa2-3254-437c-8111-34c57e564568+14:2356:x1876350857245824:12345-192.168.201.55@tcp:4:dd.0 00010000:00010000:2.0:1789428038.089353:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.089380:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789428038.089386:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428038.089395:0:16605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.089418:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789428038.170108:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:0.0:1789428038.170148:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1789428038.170268:0:15062:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:0.0:1789428038.170274:0:15062:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1789428038.170306:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.170323:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.170333:0:15062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.170343:0:15062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c7e00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428038.170416:0:15062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.170455:0:15062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.170599:0:15062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.170610:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089c19055/0x2bea1a57ca3449c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428038.170908:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10605fa2-3254-437c-8111-34c57e564568+13:2356:x1876350857245952:12345-192.168.201.55@tcp:4:dd.0 Request processed in 107972us (113649us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789428038.170924:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 4 00000100:00100000:0.0:1789428038.170976:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 6 00000100:00100000:0.0:1789428038.170990:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10605fa2-3254-437c-8111-34c57e564568+12:2356:x1876350857246208:12345-192.168.201.55@tcp:4:dd.0 00010000:00010000:0.0:1789428038.171034:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.171049:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428038.171054:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428038.171061:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.171075:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.171546:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.171560:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.171569:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.171577:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999000 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:3.0:1789428038.171581:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.171604:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.171621:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.171629:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a31f604/0x2bea1a57ca3449bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428038.171705:0:15060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10605fa2-3254-437c-8111-34c57e564568+11:2356:x1876350857245696:12345-192.168.201.55@tcp:4:dd.0 Request processed in 109946us (115248us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789428038.171714:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 3 00000100:00100000:3.0:1789428038.171746:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 7 00000100:00100000:3.0:1789428038.171758:0:15060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10605fa2-3254-437c-8111-34c57e564568+10:2356:x1876350857246080:12345-192.168.201.55@tcp:4:dd.0 00010000:00010000:3.0:1789428038.171780:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.171804:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428038.171807:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428038.171814:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428038.171824:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789428038.239887:0:16605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1789428038.239902:0:16605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789428037 -> 1789428038 00002000:00010000:2.0:1789428038.239905:0:16605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789428038 00002000:00010000:2.0:1789428038.239908:0:16605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1789428038.239930:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.239948:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.239959:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.239968:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93340e1d4800 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:2.0:1789428038.239975:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.239987:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.240013:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428038.240023:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000058d0055/0x2bea1a57ca3449cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428038.240229:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933301ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:10605fa2-3254-437c-8111-34c57e564568+15:2356:x1876350857245824:12345-192.168.201.55@tcp:4:dd.0 Request processed in 151054us (182934us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789428038.240241:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 5 00000001:00080000:2.0:1789428038.241288:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:1.0:1789428038.289355:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1789428038.290135:0:15062:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789428038.290162:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.290303:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.290314:0:15062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.290322:0:15062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933301999600 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428038.290329:0:15062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.290341:0:15062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.290367:0:15062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.290376:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c60dc3be/0x2bea1a57ca3449d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428038.290760:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10605fa2-3254-437c-8111-34c57e564568+7:2356:x1876350857246208:12345-192.168.201.55@tcp:4:dd.0 Request processed in 119766us (223770us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789428038.290806:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 6 00010000:00010000:0.0:1789428038.292918:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.292944:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.292955:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.292963:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9334421c6a00 already unused, calling callback (ffffffffc17d28b0) 00010000:00010000:0.0:1789428038.292970:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.292979:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.293006:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428038.293014:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076c6f834/0x2bea1a57ca3449db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428038.293135:0:15060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10605fa2-3254-437c-8111-34c57e564568+5:2356:x1876350857246080:12345-192.168.201.55@tcp:4:dd.0 Request processed in 121374us (226025us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789428038.293147:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 7 00010000:00010000:3.0:1789428038.473859:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428039.497331:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428039.626769:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789428039.626802:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877151232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789428039.626904:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428039.627007:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877151232 00000100:00100000:2.0:1789428039.627018:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877151232 00000100:00100000:2.0:1789428039.627092:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789428039.627105:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff933420ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877151232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428039.627157:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00080000:1.0:1789428039.627441:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428039.629149:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff933420ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877151232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2039us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428039.629166:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789428039.631440:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789428039.631459:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff933420ed3100, transno 8589934595 00000004:00080000:1.0:1789428039.631482:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789428039.631540:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877151232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428040.154369:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428040.154417:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428040.154461:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:1.0:1789428040.154517:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857246336 00000100:00100000:1.0:1789428040.154533:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857246336 00000100:00100000:1.0:1789428040.154616:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 122 00000100:00100000:1.0:1789428040.154641:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+13:2357:x1876350857246336:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789428040.154748:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:335f5f6b-62a5-411c-9395-a123e708efa6+13:2357:x1876350857246336:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 111us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428040.154757:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 122 00000100:00100000:0.0:1789428040.155031:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857246592 00000100:00100000:0.0:1789428040.155037:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857246592 00000100:00100000:3.0:1789428040.155215:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428040.155235:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428040.155251:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428040.155284:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.55@tcp (source: 12345-192.168.201.55@tcp) 00000100:00100000:3.0:1789428040.155300:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857247104 00000100:00100000:3.0:1789428040.155304:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857247104 00000100:00100000:0.0:1789428040.155370:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857246720 00000100:00100000:0.0:1789428040.155374:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857246720 00000100:00080000:1.0:1789428040.155502:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789428040.155508:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789428040.155520:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857246848 00000100:00100000:1.0:1789428040.155524:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857246848 00000100:00100000:1.0:1789428040.155624:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857246464 00000100:00100000:1.0:1789428040.155628:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857246464 00000100:00100000:1.0:1789428040.155651:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:1.0:1789428040.155688:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2357:x1876350857246848:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789428040.155745:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+6:2357:x1876350857246848:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 69us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428040.155752:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 29 00000100:00100000:1.0:1789428040.155767:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00100000:1.0:1789428040.155773:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+20:2357:x1876350857246464:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:1.0:1789428040.155801:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10605fa2-3254-437c-8111-34c57e564568+20:2357:x1876350857246464:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428040.155807:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 30 00000100:00080000:1.0:1789428040.155922:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428040.156453:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350857246976 00000100:00100000:3.0:1789428040.156462:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350857246976 00000100:00100000:3.0:1789428040.156501:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:3.0:1789428040.156511:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2357:x1876350857246592:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789428040.156824:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10605fa2-3254-437c-8111-34c57e564568+5:2357:x1876350857246592:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 313us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428040.156895:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 15 00000100:00100000:3.0:1789428040.156914:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:3.0:1789428040.156921:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2357:x1876350857247104:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789428040.156948:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2357:x1876350857247104:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 28us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428040.156954:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 16 00000100:00100000:3.0:1789428040.156965:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00100000:3.0:1789428040.156971:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2357:x1876350857246976:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:3.0:1789428040.157007:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dd2c17e-239c-4cc3-a060-6d9ba67df7be+5:2357:x1876350857246976:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 36us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428040.157013:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 17 00000100:00080000:1.0:1789428040.157122:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428040.157941:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.55@tcp, seq: 18 00000100:00100000:0.0:1789428040.157955:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10605fa2-3254-437c-8111-34c57e564568+5:2357:x1876350857246720:12345-192.168.201.55@tcp:400:kworker.0 00000100:00100000:0.0:1789428040.158023:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343b1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10605fa2-3254-437c-8111-34c57e564568+5:2357:x1876350857246720:12345-192.168.201.55@tcp:400:kworker.0 Request processed in 71us (2770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428040.158030:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.55@tcp, seq: 18 00000001:02000400:1.0:1789428040.290728:0:16642:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789428040.530641:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428041.162474:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789428041.162506:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877151360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428041.162597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428041.162705:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877151360 00000100:00100000:2.0:1789428041.162716:0:15059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877151360 00000100:00100000:2.0:1789428041.162787:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789428041.162797:0:15059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877151360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789428041.162839:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789428041.162891:0:15059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93341d924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876350877151360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428041.162898:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789428041.162986:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877151616:0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163031:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428041.163052:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789428041.163057:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877151744:0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163079:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428041.163106:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877151616 00000100:00100000:2.0:1789428041.163110:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877151616 00000100:00100000:2.0:1789428041.163137:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789428041.163144:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877151616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163200:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876350877151616:12345-0@lo:400:kworker.0 Request processed in 56us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428041.163207:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789428041.163223:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877151744 00000100:00100000:2.0:1789428041.163226:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877151744 00000100:00100000:2.0:1789428041.163265:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789428041.163271:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877151744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163300:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876350877151744:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428041.163306:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789428041.163351:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876350877151744:0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163361:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876350877151616:0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163386:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877151488:0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163415:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428041.163437:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877152000:0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163456:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428041.163480:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93341d927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876350877151360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789428041.163502:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789428041.163507:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933420ed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877151872:0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163528:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428041.163555:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877152000 00000100:00100000:2.0:1789428041.163559:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877152000 00000100:00100000:2.0:1789428041.163580:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877151872 00000100:00100000:2.0:1789428041.163583:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877151872 00000100:00100000:2.0:1789428041.163599:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789428041.163605:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877152000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163636:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876350877152000:12345-0@lo:400:kworker.0 Request processed in 31us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428041.163642:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789428041.163654:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789428041.163659:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93330387f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877151872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163684:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93330387f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876350877151872:12345-0@lo:400:kworker.0 Request processed in 25us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428041.163689:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789428041.163712:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876350877151872:0@lo:400:kworker.0 00000100:00100000:2.0:1789428041.163720:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876350877152000:0@lo:400:kworker.0 00000100:00100000:0.0:1789428041.163779:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350877151488 00000100:00100000:0.0:1789428041.163784:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350877151488 00000100:00100000:0.0:1789428041.163824:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789428041.163832:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93343a9b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3299:x1876350877151488:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789428041.163886:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789428041.163887:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93343a9b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92161c2e-b691-4539-8b6b-a6d322602ab0+19:3299:x1876350877151488:12345-0@lo:400:kworker.0 Request processed in 56us (470us total) trans 0 rc 0/0 00000100:00080000:1.0:1789428041.163892:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428041.163893:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789428041.163894:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789428041.164668:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933420ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:92161c2e-b691-4539-8b6b-a6d322602ab0:3299:1876350877151488:0@lo:400:kworker.0 00010000:00010000:3.0:1789428041.550534:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29684 lines, 29684 kept, 0 dropped, 0 bad.